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NETWORK DESIGNERS 


Announcing new NETWORK II.5 


computer and communications network analysis simplified 
you now get easy to understand answers quickly—no programming 


see how well a proposed network performs under various workloads 


Before 


After 



Costs and delays of 
computer programming 


W ith NETWORK II.5 you 

get your results quickly—no 
programming. You simply enter 
your system description through the 
interactive, user-friendly interface. 

Your description is automatically 
verified—corrections are made im¬ 
mediately. 

Your system simulated 
You can analyze any computer 
and communications system, large 
or small, including local area net¬ 
works. 

You can simulate some portions 
of the system at a detailed level and 
others at a coarser level. 

Quick, easy to understand results 
Your reports show utilization, 
queues, execution times, response 
times and conflicts. Graphical 
reports show hmdware layout, soft¬ 
ware data flow, emd device utiliza¬ 
tion as a function of time. 

Computers with NETWORK II.5 

• IBM Personal Computer AT- 
XT or compatible. 

• Most Mainframe computer 
types including IBM, CDC, VAX, 
Univac, Prime, Gould, and Data 
General. Sun and Cray NETWORK 
II.5 are under development. 



Easy model building 
no programming 




Graphical display of results 


With NETWORK II.5 you get 
results sooner and they are better 
understood. 

There is no easier, quicker way 
to evaluate alternatives. 


Free trial and training 

The free trial contains every¬ 
thing you need to try NETWORK 
II.5® on your computer. 

We send you NETWORK II.5, 
installation instructions, a sample 
network, and a complete set of 
documentation. 

You can build your network or 
modify ours. If you have ques¬ 
tions, just call us for an immediate 
response. No cost or obligation. 

Act promptly-Limited offer 

For a limited time we also in¬ 
clude free training. 

Act now to avoid disappoint¬ 
ment. 

For immediate information 

Call Paul Gorman at (619) 
457-9681. In the U.K., call Steve 
Wombell at (01) 940-3606. 


I. 

Act now for free training [ 

Free trial-learn the reasons for the 
broad and growing popularity of NET- i 
WORK II.5 —no cost or obligation. | 

Special offer-return the coupon today 
and we will include one free course enroll- I 
ment worth $850. I 


Telephone 


Computer Operating System 


Return to: ieeecomp | 

I CACI I 

j 3344 North Torrey Pines Court 

I La Jolla, California 92037 | 

I Or, better yet, call Paul Gorman at 

I (619) 457-9681 1 

I In the U.K. I 

I CACI 

I 26 The Quadrant | 

I Richmond, Surrey, England TW9 IDL I 

Call Steve Wombell at (01) 940-3606 I 

I _I 
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ARTICLES 



10 Guest Editor’s Introduction: New Computers for Artificial Intelligence 
Processing 

Benjamin W. Wah 

New computer architectures can be used to improve efficiency in the processing of some time-consuming AI tasks, but cannot 
overcome the combinatorial complexity of AI processing. 

19 Computer Architectures for Artificial Intelligence Processing 

Kai Hwang, Joydeep Ghosh, and Raymond Chowkwanyun 
This article assesses a new generation of intelligent multiprocessors and multicomputers with respect to current AI 
technologies, advanced computer architectures, and application demands. 

30 Software Development Support for AI Programs 

C. V. Ramamoorthy, Shashi Shekhar, and Vijay Garg 

In spite of the widespread commercial use of expert systems, vendors cannot guarantee the quality of the programs. 

43 Symbolics Architecture 

David A. Moon 

This architecture enables rapid development and efficient execution of large, ambitious applications. An unconventional 
design avoids trading off safety for speed. 

55 The Architecture of FAIM-1 

Judy M. Anderson, William S. Coates, Alan L. Davis, Robert W. Hon, Ian N. Robinson, Shane V. Robison, 
and Kenneth S. Stevens 

FAIM-1 can be scaled to provide two to three orders of magnitude improvement over conventional AI machines with minimal 
inconvenience to programmers. 

67 What Price Smalltalk? 

David Ungar and David Patterson 

Are reduced instruction set eomputers good for languages like Lisp and Smalltalk? With the addition of a few simple 
hardware changes and software techniques—yes. 

75 Initial Performance of the DAD02 Prototype 

Salvatore J. Stolfo 

A 1023-processor prototype named DAD02 has successfully demonstrated performance improvements for several important 
problems and has led to a number of avenues of future research. 

85 Applications of the Connection Machine 

David L. Waltz 

This massively parallel system is easily programmable, applicable to a variety of applications, and can be scaled to large 
problems by the addition of more processors. 

100 Connectionist Architectures for Artificial Intelligence 

Scott E. Fahlman and Geoffrey E. Hinton 

Massively parallel networks of simple neuron-like processing elements may hold the key to some important aspects of 
intelligence not captured by existing AI technology on serial machines. 
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9 Letters to the Editor: 

SDI should not be designed; Response to 
“LisaLearning” article 

114 Book Reviews: 

Expert Systems and Fuzzy Systems: 
Fundamentals of Digital Electronics 

115 Open Channel: 

Does more performance mean less utility? 

116 Update: 

COPP eommittee report; glossary published; 
FJCC; AFIPS seeks nominees; Eckert- 
Mauchly nominations 

121 New Products 
124 New Literature 

126 IC Announcements 

127 Microsystem Announcements 

128 Call for Papers 

129 Calendar 

130 Career Opportunities 
144 Advertiser/Product Index 

144 A Reader Service Card 
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Dennis R. Allison (cra'ifrDh^tmrP.'Agr”^^^^^^ D. Agrawal, 

James J. Farrell III, Lansing Hatfield, Michael C. Mulder, David Pessel, 



On the cover 


The fractal on our cover symbolizes 
the combinatorial explosion 
characteristic of AI processing. For 
details and other examples of frac¬ 
tals, see “About the Cover,” p. 

13. The fractals were all supplied 
by Art Matrix of Ithaca, New 
York. The cover was designed by 
Jay Simpson. 
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REGISTER NOW AND SAVE MONEY! 


Providing Technical Perspective 

Tutorials: Monday, February 23 and 
Friday February 27 

Conference: Tues-Thur, February 24-26 


YOU can’t afford to miss COMPCON Spring ’87! 

The year’s only broad-based computing conference 
by the world’s largest computer society. 

READING conference PROCEEDINGS IS NO SUBSTITUTE for hearing and interacting with speakers, audiences and peersi 



KEY HOT TOPICS: 

• EMERGING NEW MINISUPERS • EMERGING NEW SOFTWARE TRENDS 
• COMPUTER SECURITY* NETWORKING & ASSOCIATED FILE STRUCTURES 
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PROGRAM HIGHLIGHTS: 41 SESSIONS, 120 SPEAKERS 

(Subject to adjustment) 


PLENARYTALKS: 

Tuesday Morning, February 24,1987 

“Future Directions for High-end Work Stations" 

Dr, AndriesVan Dam, Brown University, 
Wednesday Afternoon, February 25,1987 
"Trends in Knowiedge Processing: From Expert 
Systems to inteiiigent Systems Engineering" 

Dr, Frederick Hayes-Roth, Teknowiedge inc. 

NETWORKS, LOCAL 8c OPEN SYSTEMS 

FDDi—Fiber Distributed Data interface, a 
New High Speed LAN Standard, 

Debate, Correct interface to Fiie Servers 
Locai Area Networks 
iSO—OSi Pros & Cons 

Al, ARCHITECTURE 8c EXPERT SYSTEMS 

The Xenologic X1 

Expert System Development Environments 
Intelligent Systems for Management Decisions 
Al for Manufacturing: CAD/CAM, Prod, Eng, 
Knowledge Net 

Expert System, Tools and Applications 
Neural Based Architectures 

SUPERCOMPUTERS AND SUPERMINIS 

Supercomputers: ETA 10, IBM 3090, EIxsi. 

Warp; Systolic Supercomputer 
Second Generation Minisupers 

SECURITY, TRUSTED NETWORKS 

Trusted Systems 
Trusted Networks 

Black Magic in Computer Security 


SOFTWARE, LANGUAGES 8c SYSTEMS 

LISP Benchmarks 

Future Computing Environments 

COBOL 85—The New Productivity Tool 

Distributed Operating Systems ] 

Technical Directions of UNIX 
Multimedia Information Environments 
High Performance Transaction Systems 
Management of Change In High Availability 
Systems 

SOFTWARE, TECHNOLOGIES 

Object Oriented Model 

Software Reuse—The State of the Malpractice 

What's Up with Ada Oompiler Technology? 

Reusable Software Component Libraries 
Window Systems, Diverging Views of Future 

INTERESTING COMPUTER ORGANIZATIONS 

AT&T Bell Labs C Machine 
Alternative Computer Architectures 
VAX 8800 System 

Audience Open Mike, Your Provocative Proposals 

OPTICS, COMPUTING 8c STORAGE 

Optical Disks, Present and Future 
New Directions in Optical Computing 

CAD, PARALLEL PROCESSING 

Parallel Processing for CAD Applications 

DIGITAL SIGNAL PROCESSING J 

Digital Signal Processing ^ 


TUTORIALS: Monday, Feb. 23,1987 

"Local Networks—Changing Directions," 

Harvey Freeman 

"Secure Operating Systems," Lyle (Terry) Cox 

"Al Machines," David Shaw 

"Software Reuse: State of the Practice." Will Tracz 


TUTORIALS: Friday. Feb. 27,1987 

"Reusable Software Engineering." Peter Freeman 
"Practical Computer Security & Cryptography" 
Russell Brand & Gilles Brassard 
"Managing Knowledge Systems Software 
Development." Avron Barr 











TUTORIALS 

Monday 2/23/87 ALL DAY 



TUTORIAL 1: Changing Directions in Local Networks 
Instructor; Dr. Harvey A. Freeman, Vice President for Engineer¬ 
ing, Architecture Technology Corporation, involved in all aspects 
of consulting, research, and publishing regarding local networks, 
office automation and communications systems. Co-author of 
Data Base Computers, co-editor of periodicals. Holds a PhD in 
EE from University of Illinois. 

Audience: Managers, engineers, programmers, systems 
analysts, designers, and students. Some experience in computing 
and some exposure to data communications is helpful. 

Abstract: This tutorial describes local area networks, a slowly 
maturing but still a fast growing technology in the systems market. 
It covers important local networking technologies, specific 
equipment, and companies’ changing strategies. 

Introduction: Overview of the field, covers early systems and 
their shortcomings, ISO reference model. 

Ethernet vs. Token-rings: Technology, cable systems, vendors, 
major local networks. 

Operational Issues: Servers, software, testing, strategy. 

Future Directions: Standards, competition, future products, 
trends. 

TUTORIAL 2: Secure Operating Systems 
instructors: Dr. Lyle A. Cox is the Senior engineering manager for 
information transport systems development for DEC. He was 
director of technology applications for the National Security 
Council at the White House, and a former professor of Computer 
Science at the Naval Post Graduate School. He has worked with 
the Departments of Defense and Energy in the areas of informa¬ 
tion systems security for the last 15 years. 

Mr. Steven Lipner Is senior engineering manager for servo 
systems development with DEC. He has been responsible for 
digital research and advanced development efforts in systems 
security since 1981. Prior to DEC, he was involved with computer 
security at Mitre since 1970. He participated in systems security 
penetration tests, development of the prototype security kernel for 
the PDP-11 /45, and design of security enhancements to the 
Multics Operating System. 

Audience: Computer system managers, software designers, and 
those concerned with operating system security. 

Abstract: (1) Fundamentals of secure operating systems and real 
technology, (2) The employment of systems, how to keep them 
secure, and (3) Policy and prevention: how to encourage honesty. 

TUTORIAL 3: Al Machines 

Instructor: Dr. David Elliott Shaw, Associate Professor of 
Computer Science, Columbia University and Director of the 
NON-VON Project for the investigation of massively parallel 


machine intelligence for Al. Doctorate from Stanford and research 
at the Stanford Artificial Intelligence Laboratory exploring fifth 
generations Al machines. 

Audience: Technical and management people Involved or 
interested in either the deveiopment or use of Al systems with 
a high-level perspective on the range of hardware options now 
available or likely to become available in the near future for Al 
applications. 

Introduction: History of Al application-oriented hardware, 
projecting to future. 

Significant Activities: Japanese Fifth Generation Project, 
DARPA’s Strategic Computing Program, and related programs In 
Western European and Soviet block countries. 

Taxonomy: Fundamental classes of machine architectures for Al. 
Current Al Machines: Personal LISP machines and VLSI LISP 
chips, pipelined devices, vision and speech understanding. 

Next Generation Architectures: Millions of processing elements, 
and projecting a future including non-von Neumann architectures 
and Al supercomputers. 


TUTORIAL 4: Software Reuse: The State of the Practice 

Instructor: Will Tracz, Advisory Programmer, IBM Federal 
Systems Division, Owego NY, and currently IBM Resident Study 
Fellow, Stanford University. Was responsible for the design and 
development of microcode support software for military and 
aerospace processors. He is newsletter editor of ACM SIGMICRO/ 
IEEE TC-Micro. He has an MS in Computer Science from the 
Pennsylvania State University, an MS in Computer Engineering 
from Syracuse University, and is currently completing his PhD at 
Stanford University. Has taught at Syracuse University and 
Rochester Institute of Technology. 

Audience: Those with an interest in new or advanced ideas on 
developing software systems to enhance programmer productivity 
and product quality by reusing programs, program segments, 
designs, or other software artifacts. Special emphasis on .Ada. 
Knowledge of Ada Is useful but not necessary. 

History: Issues, motivators, inhibitors, technical, political, 
psychological, social and economic issues related to software 

Current Practice: Emphasis on (1) developing reusable artifacts, 
(2) how to organize and locate reusable artifacts, and (3) how to 
develop artifacts. Detailed look at Japanese software factories, 
and survey of over 30 aerospace corporations, software factories, 
universities and research consortiums are surveyed. Methodology, 
management philosophy, and results/status. Summaries of 
guidelines for developing reusable software in Ada as stated by 
SofTech, EVB, and Honeywell. 


8:30 TUESDAY, FEBRUARY 24 

Welcome and Computer Society Awards 

9:30 Plenary Talk 

“Future Directions for High-End Workstations” 

Dr. Andries Van Dam —Brown University 
Supermini computer workstations developed for CAD will 
influence other disciplines. This talk covers the future 
expectations for workstation technology and applications. 

10:30-12:00 TUESDAY, FEBRUARY 24 
VAX 8800 System Dileep Bhandarkar 

VAX 8800 System Overview—D, Mclnnis: DEC 

VAX 8800 Microarchitecture—Sudhin Mishra: DEC 

VAX 8800 Cache and Memory—Jim Keller: DEC 

VAX 8800 Design Tools and Methodology—Dennis Bak: DEC 

Local Area Networks Michael Falman 

Traffic Adaptive LAN Architecture—D. Pritty: University of 
Strathcyide 

Local Area Broadcast Network Measurement—P. Amer: 

University of Delaware 

Effects of Layered Protocols on Performance of a Packet 
Radio Network—B, Boesch: Stanford University 


Expert System: Tools & Applications Y. Muraoka 

Use of an Advanced Expert Systems Tool for Faulf Free 
Analysis in Nuclear Power Plants—B, Frogner: 

Expert-Easy Systems, Inc. 

Expert System Tool with Fact/Model Representation 
Environment on PSI —H. Kubono: ICOT 
Towards an Expert System for Logic Circuits Synthesis— 

A. DiStefano: Universita Di Catania 

What's Up with Ada Compiier Technology Geoff Mendal 

Ada ComputerTechnology—M. Ganapathi and G. Mendal: 
Stanford 

Ada Compiler Technology—J. Goodenough: Software Engineerinc 
Institute 

Observations on Ada—D. Luckham: Stanford 


1:30-3:00TUESDAY FEBRUARY24 
Optical Disks —Present and Future Bruce Lowenthal 

Data Structure and Access Method Considerations 

on WORM Devices—B. Lowenthal: Tandem Computers, Inc. 
A Survey of Very Large Capacity On-Line File Systems 
Using Optical Disks —Y. Kinouchl: Nippon Telegraph and 
Telephone 

A Library Application Using Optical Disk—B. Kiser: Ohio 
College Library Corp. 












Local Network File Servers: Which One? 

Panel Session: Gene McDaniel 

Paul Sherer: 3 COMM, Corp. 

Peter Weinberger: AT&T Bell Laboratories 
Mark Stein: Sun Microsystems 

Expert System Development Environments— 

Issues and Future Directions Mike Williams 

(Titles and authors to be announced.) 

Software Reuse—the State of the Malpractice Will Tracz 

The Design of Ada Systems from Reusable Components—G. 
Booch: Rational 

STARS Reusability Guidelines—E. Wald: Naval 
Research Lab 

Parameterization Pitfalls and Potentials—J. Goguen: SRI 
Software Reuse: Motivators and Inhibitors—W. Tracz: IBM 
3:30-5:00TUESDAY, FEBRUARY 24 
The Xenologic X1 Doug DeGroot 

A Coprocessor for Al, LISP, Prolog, and Data Bases—T. Dobry: 
Xenologic, Inc. 

Integration of the Xenologic XI Al Coprocessor with General 
Purpose Computers—R. Ribler: Xenologic, Inc. 

System Level Performance Using Al Coprocessors—A. Despain: 
Xenologic, Inc. 

The Technical Directions of UNIX Mark Compton 

Mach: A New Kernel Foundation for UNIX Development—R. 

Rashid: Carnegie Mellon University 
System V Directions—T. Barrese: AT&T 
Directions of UNIX at the University of California at Berkeley—M. 
McKusick: UC Berekeley 


Intelligent Systems for Management 
Decision Support 
Panel Session: 

J.Kopcke:THORNE-EMI, 

S. Hoizman: Strategic Decisions Group, 
A. Mosleh: Pickard Lowe & Garrick, Inc,, 
R. Elmore: Syntelligence, Inc. 


Reuseable Software Component Libraries 
Panel Session: 

R. McCain: IBM, 

S. Arnold: Tl, 

W, Frakes: AT&T, 

P. Gouthier: CSELT, 

E. Berard: EVB Software Engineering 


Joseph Fiksel 


Rick Conn 


8:30-10:00 WEDNESDAY, FEBRUARY 25 

Supercomputers Ken Wallgren 

Engineering View of the ETA 10—J. Emery: ETA Systems 

IBM 3090 System Design with Emphasis on the Vector 
Facility—S. Tucker: IBM 

Engineering View of the ELXSI —L. Shar: ELXSI 

Distributed Operating Systems Hasan AIKhatib 

Design Issues in Heterogeneous Distributed Computing 
Systems—A, Hac: John Hopkins Univ. 

Branch and Bound Algorithms for Scheduling Communicating 
Tasks in a Distributed System —B. Greenblatt: Univ. of 
Southwestern Louisiana 

Al for Manufacturing Wiiliam Mark 

Changing the Nature of CAD/CAM with Al—C. Kempf: FMC 
Corp. 

Knowledge-based Engineering for Production Planning and 
Control—I. Johnson: Garegie Group 

Digital's Knowledge Network—F. Lynch: DEC 

Microprocessor Applications in Korea Jung Wan Cho 

UNIX Computer Families—K. Rim: ETRI 

Designof a Production Loom Monitoring System—M. Ko: 

Seoul National University 

An Implementation of Ring Network Controller for Real Time 
Applications—K. Park: KAIST 

TDX: A Distributed System Architecture for High Throughput 
Digital Switching—W. Yu: ETRI 

10:30-12:00 WEDNESDAY, FEBRUARY 25 

Second Generation Minisupers Kenichi Miura 

Vitesse Minisuper—C. Maples: Vitesse Electronics Corp. 

Multiflow, Hardware and Software—J. Fisher: Multiflow 
Computer Inc. 

The Personal Supercomoputer—G. Culler: Culler Scientific 

The Object Oriented Model Mohammed Ketabchl 

Implementation of Persistent Multi-User Object-Oriented 
Systems—M. Ketabchi: Univ. of Santa Clara 

Object Management in HEXUS Distributed Operating Sys¬ 
tem—A. Tripathi: Univ. of Minnesota 

Architectural Support for Object-Oriented Programming 
Languages—K. Kavi: Univ. of Texas at Arlington 

Trusted Networks Stanley Ames 

(Titles and author to be announced.) 


SPONSORED BY THE 

^ IEEE COMPUTER SOCIETY 


^ELECTHONICS EM 


FOR ROOM RESERVATIONS: CATHEDRAL HILL HOTEL, San Francisco 
Call (415) 776-8200 by January 30,1987 and mention COMPCON ’87 for Special Ratel 


REGISTER BY FEBRUARY 14th-AND SAVE MONEY! 


Please check appropriate boxes: 

CONFERENCE, lUesday-Thursday, February 24-26,8:30 AM to 5 PM 

Members: □ $175 (before 2/14/87) □ $220 (after 2/14/87) 
Non-Members: □ $230 (before 2/14/87) □ $275 (after 2/14/87) 
Tutorial registration fee includes lunch and one copy of the Tutorial Notes. No 
more than one tutorial per person per day. 

TUTORIALS, Monday. February 23.9 AM to 5 PM 

Members: □ $175 (before 2/14/87) □ $220 (after 2/14/87) 
Non-Members: □ $230 (before 2/14/87) □ $275 (after 2/14/87) 
CHECK ONE ONLY 

1. □ Local Networks— 3. □ Al Machines 

Changirig Directions 4. □ Software Reuse: State- 

2. □ Secure Operating Systems of-the- Practice 

TUTORIALS, Friday, February 27,9 AM to 5 PM 

Members: □ $175 (before 2/14/87) □ $220 (after 2/14/87) 
Non-Members: □ $230 (before 2/14/87) □ $275 (after 2/14/87) 
CHECK ONE ONLY 

5. □ Reusable Software 7. □ Managing Knowledge 

Engineering Systems Software 

6. □ Practical System Security Development 

and Cryptology 


Requests for refunds must be received in w 
1987. Limited tutorial attendance is on a first 
■ ation fee includes one copy of th 


ater than February 21, 
_ _:-served basis. Confer- 
Compcon Digest of Papers. 


as well as admittance to the conference-hosted pa 
•PAYMENT MUST BE POSTMARKED BY FEBRUARY 14 TO QUALIFY FOR 
ADVANCE REGISTRATION RATES. Note: AFTER 2/14/87 ALU RATES IN¬ 
CREASE BY $45. 


PLEASE COMPLETE THIS FORM AND RETURN TO 

COMPCON Spring '87 

c/o Robert M. Long, Lawrence Livermore National Laboratory 
RO. Box 808, MS L-130; Livermore, CA 94550 
Telephone: (415) 422-8934. 


_ (sum of boxes checked) 


CM JAN 87 

ON-SITE REGISTRATION will be accepted at the Cathedral Hill Hotel begin¬ 
ning Sunday evening, February 22,1987. 

Payment should be for sum of boxes checked. No purchase orders. Foreign 
checks must be in U.S. dollars drawn on U.S. bank. Credit card registration is 
available by phone. 














Parallel Architectures and Shreekant Thakkar 

Programming 

Arrays, Non-determinism, and Paralielism: A Purely Functional 
Approach to Parallel Programming —P. Hudak: Yale University 
Translating Sequential Languages for Concurrent Execution 
—G. Graunke: Sequent Computer Systems 
Parallel Programming on Transputer Based Systems— 

P, Wilson: Inmos Corp. 

Experience with Three Parallel Programming Systems—S. 
Thakkar: Oregon Graduate Center 

1:30-3:00 WEDNESDAY, FEBRUARY25 
Neural Based Architectures Robert Dourandish 

A Neural Based Knowledge Processor—J. Voevodsky: 

Neuro Logic, Inc. 

Connectionists, Symbol Processing in Neural Based 
Architectures—D.Touretzky: Carnegie-Mellon Univ, 

Drawbacks with Neural Based Architectures—D. Partridge: 

New Mexico State Univ. 

Timing Dependencies in Sentence Comprehensjon —H. 

Gigly: Univ. of New Hampshire 

ISO-OSI Pros and Cons Hasan AIKathib 

Panel Session: 

J. Foley: EDS Corp., 

S. Dillon: GM Research Lab, 

D. Cheriton: Stanford Univ., 

R. Rashid: CMU 

Parallel Processing for CAD Applications Kit Tham 

NDOT2P: A High-Performance Architectural Simulation Tool—R. 
Smith: MCC 

Distributed Circuit Simulation with EMU: A Case Study of Three 
Parallelization Strategies—S. Lucco: AT&T Bell Labs. 

The Connection Machine—General Purpose Accelerator for 
VLSI CAD—R. Friebrick: Thinking Machines, Inc. 

Switch-Level Simulation on a Hypercube MIMD Computer— 
K.Tham: Mentor Graphics, Corp. 

Digital Signal Processing Edward Lee 

Application-Specific CAD of High-Throughput Digital Filters —P. 
Cappello: UCSB 

Distributed Computer Architecture for Digital Signal Processing — 
Y. Oyang: Stanford Univ. 

Synchronous Data Flow: Describing Signal Processing Algorithms 
of Parallel Computation —E. Lee: UCB 

3:30-5:00 WEDNESDAY, FEBRUARY25 
Plenary Talk—"Trends in Knowledge Processing: From 
Expert Systems to Intelligent Systems Engineering” 

Dr. Frederick Hayes-Roth—Chief Scientist, Teknowledge,lnc. 

The need to integrate knowledge processing with conventional data 
processing has resulted in a new class of systems, “Intelligent 
Systems. ’’This talk covers R & D techniques and proto-prod¬ 
ucts to aid the rapid creation of such systems, 

8:30-10:00THURSDAY, FEBRUARY 26 
The AT&T Bell Labs C Machine David Pattersion 

Introduction to the CRISP Microprocessor—D. Ditzel: AT&T Bell 
Labs 

Architectural Innovations in the CRISP Microprocessor—D. 

Ditzel: AT&T Bell Labs 

Compiling Code for the CRISP Microprocessor—S. Ban- 
dyopadhyay: AT&T Bell Labs 


Black Magic in Computer Security Russell Brand 

Apparently Impossible Information Exchanges and How to 
Accomplish Them—G. Brassard 
Impossibly Correct Systems and How to Guarantee Them—B. 
Baldwin 

Perfect Authentication Passwords, ID Cards, or Extra Sensors— 

J. Garcia 

10:30-12:00THURSDAY, FEBRUARY26 
WARP: A Systolic Supercomputer Thomas Gross 

The Architecture of a Systoiic Supercomputer— 

M. Annaratonne: Carnegie-Meilon Univ. 

Software Development for a Systolic Supercomputer—T. 

Gross: Carnegie-Mellon Univ. 

Putting Applications on a Systolic Supercomputer-J. Webb: 
Carnegie-Melion Univ. 

Window System Futures Keith Lantz 

Panel Session: 

J. Gosling: Sun Microsystems, 

E. Smith: CMU, E. Schoen: Stanford Univ., 

E. Schoen: Stanford Univ., 

R. Scheifler: MIT 

Management of Change in High Availability Bob Good 

Systems 

Managing Change in a High Dollar Electronic FundsTransfer 
Environment—B.Weintraub: Precision Business Systems 
IMS Change Management at Bank of America—D. Hughes: 
Bank of America 

Change Management for a Railroad Operations Control 
System—W. Zigmat: Southern Pacific 
Change Management in Real Time Systems—S. Beard: 
American Airlines 

Trusted Systems William Chase 

(Titles and authors to be announced.) 

1:30-3:00THURSDAY, FEBRUARY26 
Alternative Computer Architectures Roger Anderson 

Black Algorithms for High Speed Computing —B. Friedlander: 

SAXPY Computer Corp. Inc. 

Choop—L. Higbie: Sullivan Computer Corp. 

Connection Machine—G. Rancourt:Thinking Machine Corp. 

Multimedia Information Environments Theodore Laliotls 

Multimedia Aspects of CD-I —M. Edmead: MTE Associates 
A Multimedia Form Query Language—D. Dadal: HP Labs 
Authoring System Challenges for Multimedia Environments— 

J. Huston:The Engineering Department 

COBOL 85—The New Productivity Tool Donald Nelson 

Productivity Features and the Future —D. Nelson: Tandem 
Computers, Inc. 

The Standardization of COBOL 85—J. Banttaja: Microtec 
Research 

A Major COBOL 85 Application—G. Hall: Eyring Research 

FDDI — Fiber Distributed Data Interface Floyd Ross 

FDDI—an Overview—F. Ross: Sperry 
FDDI System Performance—L. Green: Advanced Computer 
Communications 

LED Source and Fiber Specifications Issues for the FDDI 
Standard—D. Hanson: HP 


Future Computing Environments Ephraim Glinert 

Intelligent Assistance Without Artificial Intelligence—G. Caiser: 
Columbia Univ. 

An Editor for Program Design—M. Zelkowitz: Univ. of Maryland 
STILE: A Graphical Design and Development Environment—M. 
Stovsky: Ohio State Univ. 

Trends in Interactive Preparation of Documents—R. Furuta: Univ. 
of Maryland 

High Performance Transaction Systems Andreas Reuter 

Bildschirmtext—Usage Characteristics and Performance of the 
German Videotext System—H. Fromm: IBM 
TPF—Capacity, Availability, and Performance—T. Scrutchin: 

Boole and Babbage 

The Architecture of a Stock IVfarket System—H. Sammer: 

Tandem Computers, Inc. 


LISP Machine Architecture Issues—R. Lim: NASA Ames 
Research Center 

High-Level Language LISP Processor—S. Krueger:TI 
Kyoto Common LISP—F. Giunchiglia: IBUKI, Inc. 


New Directions in Optical Computing Lee. Giles 

Optical Neural Networks—D. Psaltis: California Institute of 
Technology 

Computational Issues in Optical Digital Computing—B. Jenkins: 

use 

Optical SIMD Arrays—T. Drabik and S. Lee: UCSD 


Attendees’ Open Mike Jim Warren 

Air your ideas! You have up to ten minutes to present proposals, 
discuss mistakes, suggest projects, report on work in 
progress and communicate cautions. Sign up with the 
chairman to air your hotly-held heresies. 





TUTORIALS 

Friday 2/27/87 ALL DAY 


TUTORIALS: Reusable Software Engineering 
Instructor: Peter Freeman, Associate Professor of Information 
and Computer Science at the University of California at Irvine. 
Analysis design, and construction of advanced computer applica¬ 
tions and training of software engineers since 1961. Author of 
Software Systems Principles, joint editor of two other books, 
author of numerous technical papers. Doctorate in Computer 
Science from Carnegie-Mellon University, 1970. 

Audience: Technical managers and development personnel at all 
levels who are interested in the effective reuse of software 
engineering workproducts (code, designs, specifications, tc.), and 
the relative importance of dtfferenf approaches. 

Fundamentals: Basic concepts, technical issues, management 
issues, economics. 

Current Practice: Language approaches, libraries/catalogs, 
component factories, software factories, portability. 

Getting Started: How to set up a library, obtain programmer 
support and management support, make improvements. 

Other Applications and Issues: Application generators, 
handbooks, standards. 

Research:Transformational approaches, domain-modelling 
paradigm, design representations. 

TUTORIAL 6: Practical System Security 
and Cryptography 

Instructors: Russell Brand, member of the Computation 
Research Group, Lawrence Livermore National Lab. Doing 
graduate studies at the University of California at Berkeley, 
undergraduate degree from MIT. Gilles Brassard, Associate 
Professor of Computer Science, Universite de Montreal. He has 
taught algorithms and cryptology at the University of California at 
Berkeley and does research in probabilistic algorithms, fundamen¬ 
tal cryptography and cryptographic protocol design. Doctorate in 
Computer Science at Cornell University under the direction of 
John Hopcroft. 

Audience: Those interested in practical issues of computer 
security, defenses against often overlooked common problems 


and attacks, simple methods to plug large classes of security 
problems with examples from UNIX and analogies in VMS, and 
practical issues in computer cryptography emphasizing current 
.'computation limitations, and affordable levels of protection. 
lntroduction:Threats, attacks, solutions. 

Log-in: Pre-login, post-login, guessing passwords, pre-built bugs, 
trusted hosts. 

Attack Levels: Crackers, resource thieves, spies. 

Solutions: Prevention, passwords, trusted hosts, detection, and 
post-login solutions. 

Special Threats: Financial, academic, and real-time control 
systems. 

Other: Unfriendly requests, communicating problems, VMS and 
UNIX source code issues, impersonations. 

TUTORIAL 7: Managing Knowledge Systems Develop¬ 
ment 

Instructor: Avron Barr, Aldo Ventures, offers services to Al product 
developers and knowledge system builders. Studied at Cornell 
University, at the University of California at Berkeley, and at 
Stanford University, and has degrees in Mathematics, Physics, 
and Computer Science. A Research Associate at Stanford, he was 
in charge of managing the large Handbook of Artificial Intelligence, 
a three-volume book for which he became co-editor. Barr was a 
co-founder of Teknowledge, Inc., a leading Knowledge Engineer¬ 
ing firm. 

Audience: Software engineers and managers interested in 
Knowledge Engineering, the wide utility of a new Software 
Engineering methodology, and knowledge system development 
do’s and don'ts as gleaned from experience. 

Fundamentals: Knowledge-based software and review of history 
of some typical, fielded commercial applications of the technology. 
Project Manager: Learning the alternatives, hurdles, dangers, 
and making decisions at each stage. 

Software Project Stages: Choosing application, planning, 
resource allocations and team skills, acquiring special-purpose 
knowledge engineering tools from vendors, preliminary knowledge 
acquisition and rapid prototyping, iterative refinement, knowledge 
base design'as software design, systems integration and fielding, 
and maintenance and knowledge updating. 

Future: Prediction of expected developments in the Knowledge 
Engineering industry with implications for computing in general. 
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LETTERS TO THE EDITOR 


SDI should not be designed 


To the editor: 

Computer magazine is to be com¬ 
mended for publishing one of the more 
fair-minded articles concerning SDI soft¬ 
ware (“Can software for the Strategic 
Defense Initiative ever be error-free?,” 
Nov. 1986). However, I still came away 
feeling more strongly than ever that such 
a system should not be designed. Let me 
explain why. 

The main conclusion of the article can 
be stated as follows: If a large number of 
highly talented professionals spend tens 
of thousands of hours (or more) design¬ 
ing a set of programs that may be as long 
as several million lines, then it is highly 
likely that the number of errors present 
in these programs can be expected to 
decrease over time. The more time spent 
analyzing and testing the code, the 
smaller the error count becomes. 

A major danger is that should such an 
effort ever take place, we may eventually 
become convinced that we can and in¬ 
deed should rely on such a system as the 
Strategic Defence Initiative is intended to 
promote. We may believe that we re¬ 
duced an estimated error count to a 
value that gives us the confidence (i.e., 
read arrogance) that through an exhau¬ 
stive scientific effort, we have truly 
rendered nuclear weapons “impotent 
and obsolete.” Of course the Soviets are 
already concerned that it is their 
weapons that may be so rendered. They 
are worried that US missiles and other 
weapons will then be available for attack 
or intimidation. That such an SDI sys¬ 
tem could also be used as an offensive 
weapon is not publicly discussed. 

The existence of nuclear weapons on 
earth is not a problem with solely a 
technological solution. There is no in¬ 
structor’s manual containing the answer 
to the question, “How can the 100-t- na¬ 
tions of the earth learn to coexist without 
the larger ones threatening to exter¬ 
minate one another and the smaller ones 
striving to attain such a capability?” 
President Reagan and others are to be 
lauded for trying to find a way to rid the 
planet of the nuclear menace. But at¬ 
tempting this with a purely technological 
approach dramatically oversimplifies the 
nature of the problem. (It should be 
noted that the sanest technological deci¬ 
sion the US could make at present would 
be to stop all nuclear weapons testing. 


Not a single line of code need be written, 
much less tested, to do this.) 

Rather than build SDI, we should be - 
developing technologies that enhance the 
mutual security of all nations. Using an 
array of sophisticated satellites to 
monitor various troubled regions of the 
planet and making the gathered data 
widely available would be a start. In ad¬ 
dition, we (and the Soviets) should be 
seriously developing renewable energy 
sources. Relying on fossil fuels is certain 
to lead to future wars as supplies become 
threatened. Finally, we should consider 
the suggestion of Carl Sagan (and others) 
to join with the Soviets in a spaceflight 
to Mars. Such a venture would surely be 
a wiser use of advanced computer tech¬ 
nology than SDI. 

There ARE valid reasons why the US 
and the USSR both feel the need to 
prepare to exterminate the other nation. 
But if we are ever to see a world without 
nuclear weapons, we shall have to begin 
to understand the historical, cultural, 
psychological, and spiritual elements that 
have led us to our present perilous state. 
Continuing to seek simplistic SDI-type so¬ 
lutions only perpetuates the arms race and 
further impoverishes both our nations. 

Richard Steinberger 

Senior Software Engineer 

SRI International 

Menlo Park, Calif. 

Response to 
“LisaLeaming” article 

To the editor: 

While I do not question the integrity of 
the authors, I was surprised to dis¬ 
cover, in the November issue, an article 
(“LisaLearning”) authored by two IBM 
employees that reviewed the user interface 
of an Apple Computer, Inc., product. 

I personally know several computer- 
illiterate individuals who love the Macin¬ 
tosh mouse and desktop user interface 
metaphor. Perhaps next month Steve 
Jobs should author a study of the IBM 
System 370 user interface. 

Gary Kiliany 

Vice President, Engineering 

Sentient Systems Technology, Inc. 
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Guest Editor’s Introduction 


New Computers for 
Artificial Intelligence 
Processing 


Benjamin W. Wah 

University of Olinois at Urbana-Champaign 


New computer architectures can be used to 
improve efficiency in the processing of some time- 
consuming AI tasks, but cannot overcome the 
combinatorial complexity of Al processing. 


T his special issue of Computer is 
about recent efforts to produce 
hardware and software architec¬ 
tures that support artificial intelligence 
(AI) applications. The earliest computer 
design to support AI processing was the 
implementation of Lisp on the PDP-6 
computer and its successors, the PDP-10 
and PDP-20, all made by the Digital 
Equipment Corporation. The half-word 
instructions and the stack instructions of 
these machines were developed with Lisp’s 
requirements in mind. Since then, we have 
been seeing a proliferation of special- 
purpose computers that can support sym¬ 
bolic and AI processing. These efforts in¬ 
clude the implementation in hardware of 
primitive operations fundamental to ap¬ 
plications in AI, the design of a collection 
of primitive architectures to support more 
complex functions, and the design of 
system-level architectures to support one 
or more languages or knowledge-represen¬ 
tation schemes. 


Characteristics of Al 
computations 

To develop a special-purpose computer 
to support AI processing, the require¬ 
ments of AI applications must be fully 


understood. Conventional numerical algo¬ 
rithms are usually well analyzed, and 
bounds on computational performance can 
be established. In contrast, many AI appli¬ 
cations are characterized by symbolic pro¬ 
cessing, nondeterministic computations, 
dynamic execution, large potential for 
parallel and distributed processing, 
knowledge management, and open 
systems. 

Symbolic processing. AI applications 
generally process data in symbolic form. 

Primitive symbolic operations, such as 
comparison, selection, sorting, matching, 
logic set operations (union, intersection, 
and negation), contexts and partitions, 
transitive closure, and pattern retrieval 
and recognition are frequently used. At a | 

higher level, symbolic operations on pat¬ 
terns such as sentences, speech, graphics, 
and images may be needed. 

Nondeterministic computations. Many 
AI algorithms are nondeterministic, that 
is, it is impossible to plan with the available 
information the procedures that must be 
executed and terminated. This comes 
from a lack of knowledge and from an in¬ 
complete understanding of the problem, j 

and results in the need to enumerate all 
possibilities exhaustively when the prob¬ 
lem is solved. I 
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Dynamic execution. Owing to this lack 
of complete knowledge and to the uncer¬ 
tainty of the solution process, the 
capabilities and features of existing data 
structures and functions may be defined, 
and new data structures and functions 
may be created, when the problem is ac¬ 
tually solved. Further, the maximum size 
for a given structure may be so large that it 
is impossible to allocate the necessary 
memory space ahead of time. As a result, 
memory space may have to be dynamically 
allocated and deallocated when the prob¬ 
lem is solved. 

Large potential for parallel and distrib¬ 
uted computing. In parallel processing of 
deterministic algorithms, a set of neces¬ 
sary and independent tasks must be found 
and processed concurrently. This class of 
parallelism is called AND- parallelism. In 
AI processing, the large degree of nonde¬ 
terminism offers an additional source of 
parallel processing. Tasks at a nonde- 
terministic decision point can be processed 
in parallel. This latter class is called OR- 
parallelism. 

Knowledge management. Knowledge is 
an important component in reducing the 
eomplexity of solving a given problem: 
More useful knowledge means less ex¬ 
haustive searching. However, many AI 
problems may have a very high degree of 
inherent complexity, hence the amount of 
useful knowledge may also be exceedingly 
large. Further, the knowledge acquired 
may be fuzzy, heuristic, and uncertain in 
nature. The management, representation, 
manipulation, and learning of knowledge 
are, therefore, important problems to be 
addressed. 

Open systems. In many AI applications, 
the knowledge needed to solve the prob¬ 
lem may be incomplete because the source 
of the knowledge is unknown at the time 
the solution is devised, or because the en¬ 
vironment may be changing and cannot be 
anticipated at design time. AI systems 
should be designed with an open concept 
and allow continuous refinement and ac¬ 
quisition of new knowledge. 


Design issues 

The essential issues in designing a com¬ 
puter system to support a given AI ap¬ 
plication can be classified into the 
representation level, the control level, and 
the processor level (see Table 1). 


• The representation level deals with the 
knowledge and methods to solve the prob¬ 
lem, and the means to represent it. 

• The control level is concerned with the 
detection of dependencies and parallelism 
in the algorithmic and program represen¬ 
tations of the problem. 

• At the processor level, the hardware 
and architectural components needed to 
evaluate the algorithmic and program rep¬ 
resentations are developed. 

Many current designs start with a given 
language or knowledge-representation 
scheme; hence, the representation level is 
already fixed. Research has been focused 
on automatic methods to deteet parallel¬ 
ism, as well as on providing hardware sup¬ 
port for time-consuming operations. 
However, the representation level is an im¬ 
portant element in the design process and 
dictates whether the given problem can be 
solved in a reasonable amount of time. At 
this time, little has been done in providing 
tools (a) to aid users in collecting and or¬ 
ganizing knowledge or (b) to aid them in 
designing efficient algorithms. 

Hierarchy of meta-knowledge. Domain 
knowledge refers to objects, events, and 
actions per se, while meta-knowledge in¬ 
cludes the extent and origin of the domain 
knowledge of a particular object, the relia¬ 
bility of certain information, and the pos¬ 
sibility that an event will occur. In other 
words, meta-knowledge is knowledge 
about domain knowledge. Meta-knowl¬ 
edge can be considered as existing in a 
hierarchy. That is, meta-knowledge is in¬ 
volved in deciding the appropriate domain 
knowledge to apply, while meta-meta- 
knowledge is the control knowledge about 
the meta-lcnowledge. Higher level meta¬ 
knowledge is commonsense knowledge 
known to humans. 

The use of meta-knowledge allows one 
to express the partial specification of pro¬ 
gram behavior in a declarative language, 
hence making programs more aesthetic, 
simpler to build, and easier to modify. 
Moreover, it facilitates incremental system 
development: that is, one can start from a 
search-intensive algorithm and incremen¬ 
tally add control information until one ob¬ 
tains an algorithm that may be search-free. 
Lastly, many knowledge-representation 
schemes and program paradigms, such as 
logic, frame, semantic network, and 
object-oriented languages, can be in¬ 
tegrated with the aid of meta-knowledge. 

There are many open problems related 
to the use of meta-knowledge: its unam¬ 
biguous specification, its consistency 


Table 1. Design issues in AI architec¬ 
tures. 

Representation level 

Hierarchy of meta-knowledge 
Domain-knowledge representation 
AI languages and programming 

Control level 

Truth maintenance 
Partitioning and restructuring 
Synchronization 
Scheduling 

Processor level 

Micro-level architectures 
Macro-level architectures 
System-level architectures 


verification, the learning of new meta¬ 
knowledge, and the use of appropriate 
statistical metrics. 

Domain-knowledge representation. 

Declarative representations specify static 
knowledge, while procedural representa¬ 
tions specify static knowledge as well as 
the control information that operates on 
the static knowledge. 

Declarative representations are referen- 
tially transparent', that is, the meaning of a 
whole can be derived solely from the 
meaning of its parts and is independent of 
their historical behavior. Declarative 
representations offer a higher potential for 
parallelism than procedural representa¬ 
tions, but are usually associated with a 
large search space that may partly counter¬ 
act the gains of parallel processing. 

In contrast, procedural schemes allow 
the specification and direct interaction of 
facts and heuristic information, hence 
eliminating wasteful searching. However, 
they may over-specify the precedence con¬ 
straints and restrict the degree of parallel 
processing. When one chooses the ap¬ 
propriate representation scheme, trade¬ 
offs must be performed as regards the 
amount of memory space required to store 
the knowledge, the time allowed for mak¬ 
ing inferences, the expected usage of the 
knowledge, and the underlying computer 
architecture and technological limitations. 

AI languages and programming. Con¬ 
ventional imperative languages are inade- 
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quate to AI programming owing to its 
inefficiency in symbolic and pattern 
processing and its unacceptable program¬ 
ming complexity. New AI languages 
feature large declarative power, symbolic 
processing constructs, representation of 
information by lists, and use of recursion 
as the only control mechanism. Function-, 
logic-, and object-oriented languages are 
the major programming paradigms used 
for AI today, and hybrids of these 
paradigms have been developed. These 
languages differ in their expressive 
power, their ease of implementation, 
their ability to specify parallelism, and 
their ability to include heuristic 
knowledge. A language-oriented AI 
computer will inherit all the features and 
limitations of the language it implements. 

Truth maintenance. Many AI applica¬ 
tions are characterized by a lack of consis¬ 
tent and complete knowledge at the repre¬ 
sentation level. Hence, it may be necessary 
to modify the existing knowledge base 
continually and to maintain its consistency 
as new knowledge is acquired. Truth 
maintenance consists of recognizing an in¬ 
consistency, modifying the state to remove 
the inconsistency, and verifying that all in¬ 
consistencies are detected and corrected 
properly. The process of removing incon¬ 
sistencies may be inconsistent itself, and 
may introduce further inconsistencies into 
the knowledge base. 

Partitioning and restructuring. These 
refer to the reorganization and decompo¬ 
sition of the knowledge base and the AI 
program to achieve more efficient process¬ 
ing. The issues that need to be considered 
are similar to those considered for conven¬ 
tional multiprocessing and parallel pro¬ 
cessing systems, namely, granularity, static 
and dynamic detection of parallelism, and 
restructuring. However, the methods to 
resolve these issues are different. Owing to 
the nondeterminism encountered in AI 
processing, AI tasks may be decomposed 
into a large number of smaller tasks, which 
will influence the design of a special- 
purpose computer system to support AI 
processing. Many of the proposed AI 
systems have a collection of simple pro¬ 
cessing elements to execute tasks of small 
granularity and another collection of more 
complex processing elements to execute 
tasks of larger granularity. 

The detection of parallelism is also com¬ 
plicated by the nondirectionality of the 
modes of variables, the dynamic creation 
and destruction of data, and the nondeter¬ 


minism. In many languages designed for 
AI processing, the input/output modes of 
variables and the necessary data structures 
are defined at run time. Static analysis, 
allocation, and scheduling are impossible 
here. Dynamic detection and scheduling 
do not give satisfactory performance be¬ 
cause of their relatively high overheads for 
tasks of small granularity. One popular so¬ 
lution is to require users to supply addi¬ 
tional information in order to allow 
compile-time analysis. The amount of 
speedup that parallel processing of nonde- 
terministic tasks will provide is not clear, 
although the potential for processing these 
tasks in parallel is great. Without ap¬ 
propriately guiding the search, restructur¬ 
ing the program, and detecting redundant 
computations, much of the power of 
parallel processing may be directed toward 
fruitless searches. 

Synchronization. There are two levels 
of synchronization: control-level syn¬ 
chronization and data-level synchroniza- 

In procedural languages, if a statement 
precedes another statement in the pro¬ 
gram, the implication is that this statement 
precedes the second statement if the two 
statements share common variables; that 
is, control-level synchronization is implicit 
when data-level synchronization is needed. 
This implicit execution order may over¬ 
specify the necessary control-level syn¬ 
chronization in the problem. 

On the other hand, if the tasks are 
specified as a set over a number of 
declarative languages, then control-level 
synchronization is absent, and the set of 
tasks can be processed in parallel if the 
tasks do not share common variables. 

If the tasks have common variables but 
are semantically independent, then they 
have to be processed sequentially in an ar¬ 
bitrary order to maintain data-level syn¬ 
chronization. The difficulty of specifying 
control-level synchronization when tasks 
are semantically dependent is a major 
problem in declarative languages, such as 
Prolog. For example, the decomposition 
of a set into two subsets in Quicksort must 
be performed before the subsets are 
sorted. Hence, the tasks for decomposi¬ 
tion and for sorting the subsets are both 
semantically dependent and data depen¬ 
dent. To overcome this problem, pro¬ 
grammers are provided with additional 
primitives, such as the input/output 
modes of variables in a Prolog program, 
to specify the necessary control-level syn¬ 
chronization. These primitives may have 


side effects and may not be able to specify 
completely all control-level synchroniza¬ 
tion in all situations. These problems may 
have to be dealt with at run time until suf¬ 
ficient information is available to solve 
them. 

In short, there is a trade-off between the 
expressive power of the language and the 
implementation difficulty in designing a 
special-purpose computer system to sup¬ 
port an AI language. New languages that 
combine the ability of functional lan¬ 
guages to specify parallel tasks and that of 
logic languages to specify nondeterminism 
are evolving. 

Synchronization is needed when the 
system is message-based, but may not be 
needed in systems that are value-based or 
marker-based. In a value-based system, 
multiple values arriving at a processor 
simultaneously are combined into a single 
value, hence contention will not happen 
and synchronization is not necessary. 
Neural networks and the Boltzmann 
machine are examples of this class. In 
systems supporting marker-passing, such 
as NETL and the Connection Machine, 
markers in a set represent entities with a 
common property and are identified in a 
single broadcast, hence synchronization is 
not necessary. 

Scheduling. Scheduling is the selection 
of ready tasks to assign to available pro¬ 
cessors. It is especially important when 
there is nondeterminism in the algorithm. 
Scheduling can be static or dynamic. Static 
scheduling is performed before the tasks 
are executed, while dynamic scheduling is 
carried out when the tasks are executed. 

The difficulty in designing a good 
scheduler lies in the heuristic metrics to 
guide the nondeterministic search. The 
metrics used must be efficient and ac¬ 
curate. Trade-offs must be made among 
the dynamic overhead incurred in com¬ 
municating the heuristic-guiding and 
pruning information, the benefits that 
would be gained if this information led the 
search in the right direction, and the 
granularity of tasks. 

In practice, the merits of heuristic 
guiding are not clear, since the heuristic in¬ 
formation may be fallible. As a result, 
some AI architects do not schedule nonde¬ 
terministic tasks in parallel. The excessive 
overhead coupled with the fallibility of 
heuristic information also leads some 
designers to apply only static scheduling to 
AI programs. 

Micro-level, macro-level, and system- 
level architectures. The VLSI technology 
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that has flourished in the past 10 years has 
resulted in the development of many 
special-purpose computers. 

• Micro-level architectures to support 
AI processing consist of architectural 
designs that are fundamental to applica¬ 
tions in AI. 

Examples of basic computational prob¬ 
lems that are solved efficiently in VLSI are 
set intersection, transitive closure, con¬ 
texts and partitions, best-match recogni¬ 
tion, recognition under transformation, 
sorting, string and pattern matching, dy¬ 
namic programming, selection, and proxi¬ 
mity searches. Special features in AI lan¬ 
guages that are overhead-intensive can 
also be supported by hardware. Examples 


of these architectures include the unifica¬ 
tion hardware, tag bits for dynamic data¬ 
type checking, and hardware stacks. 

• The macro-level is an intermediate 
level between the micro-level and the sys¬ 
tem level. Macro-level architectures can be 
made up of a variety of micro-level archi¬ 
tectures and can perform more complex 
operations. Examples include the dic¬ 
tionary and database machines, architec¬ 
tures for searching, and architectures for 
managing dynamic data structures (such 
as the garbage-collection hardware). 

• The system-level architectures 
available today are generally oriented 
toward one or a few of the languages and 
knowledge-representation schemes and 


designed to provide architectural support 
for overhead-intensive features in these 
languages and schemes. Examples include 
systems to support functional program¬ 
ming languages, logic languages, object- 
oriented languages, production rules, 
semantic networks, and special applica¬ 
tions, such as robotics and natural-lan¬ 
guage understanding. 

Design methodology 

The issues classified in Table 1 provide a 
view to the design methodology for spe¬ 
cial-purpose computers that support AI 
processing. The various approaches can be 



About the cover 


The explosion of form and color here 
and on the cover symbolizes the com¬ 
plexity of AI processing—its com¬ 
binatorial complexity. The enumerative 
nature of many algorithms used in AI 
applications can lead to endless searching 
for the correct combinations. The key to 
harnessing this unbridled combinatorial 
stampede is to establish good heuristics 
and efficient computers. 

The graphics were created by a 
graphics program of an iterative process 
in which the output of the polynomial 
y= + c provides the input for the 
same equation, whose output in turn 
becomes input, and so on. The images, 
m an infinite regress, are made up of 
smaller and smaller clones of the parent 
image. The colorless areas of the images 
locate a set of numbers in the complex 


plane known in the field of fractal 
geometry as the Mandelbrot set—named 
after Benoit Mandelbrot of the IBM 
T. J. Watson Research Center.'"^ 

The images were generated at the Cor^ 
nell National Supercomputer Facihtyin I 
conjunction with the university’s / 
Mathematics Department and Theory I 
Center. They were computed on Floating' 
Point System’s Models 164 or 264 Array 
Processors attached to an IBM 3090/400 
Quad Processor mainframe running 
VM/370 Extended Architecture with 999 
million bytes of virtual address space. 
They were displayed on an Advanced 
Electronics Design model 512 graphics 
tube. The AED 512 was attached to the 
IBM 3081 via a 9600-baud RS-232 port 
and a Device Attachment Control Unit 
7170 high-speed communications line. 


They were photographed with a Canon 
AI Camera equipped with a Vivitar 
70-150 zoom lens with Fujicolor or Fuji- 

rhrnmp im fi|m pq t mid 1 tlTuiliT " 

.— TftepHotOT were provided courtesy of 
Homer Wilson Smith of Art Matrix, 
Ithaca, New York, whose stock of 
photos of the Mandelbrot set are / 
stemarkable for their complex beauty,/ 
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classified as top-down, bottom-up, and 
middle-out. 

Top-down design methodology. This 
approach starts by defining, specifying, 
refining, and validating the requirements 
of the application; devising methods to 
collect the necessary knowledge and meta¬ 
knowledge; choosing an appropriate rep¬ 
resentation for the knowledge and meta¬ 
knowledge; studying problems with the 
given representation scheme that are 
related to the control of correct and effi¬ 
cient execution; identifying functional re¬ 
quirements of components; and mapping 
these components, subject to technologi¬ 
cal and cost constraints, into software 
and micro-level, macro-level, and sys¬ 
tem-level architectures. 

The process is iterative. For example, 
the representation of knowledge and the 
language features may be changed or re¬ 
stricted if it is discovered that the func¬ 
tional requirements cannot be mapped 
into a desirable and realizable system with 
the given technology and within the set 
cost. In some projects, the requirements 
may be very loose and span many different 
applications. As a result, the languages 
and knowledge-representation schemes 
used may be oriented toward general-pur¬ 
pose usage. The Japanese Fifth-Genera¬ 
tion Computer System project is an at¬ 
tempt to use a top-down methodology to 
design an integrated, user-oriented, intelli¬ 
gent system for a number of applications. 

Bottom-up design methodology. In this 
approach, the designers first design the 
computer system; the design is based on a 
computational model (such as dataflow, 
reduction, or control-flow) and the tech¬ 
nological and cost limitations. Both possi¬ 
ble extensions of existing knowledge- 
representation schemes and languages 
developed for AI applications are im¬ 
plemented on the given system. Finally, AI 
applications are coded by means of the 
representation schemes and languages 
provided. This is probably the most popu¬ 
lar approach to applying a general-pur¬ 
pose or existing system to AI processing. 
However, it may result in ineffieient pro¬ 
cessing, and the available representation 
schemes and languages may not satisfy the 
application requirements. 

Middle-out design methodology. This 
approach is a short-cut to the top-down 
design methodology. It starts from a prov¬ 
en and well-established knowledge-repre¬ 
sentation scheme or AI language (most 


likely a scheme or language developed for 
sequential processing) and develops both 
the architecture and the modifications to 
the language or representation scheme 
that are necessary to adapt to the applica¬ 
tion requirements. 

This is the approach taken by many de¬ 
signers in designing special-purpose com¬ 
puters for AI processing. It may be subdi¬ 
vided into top-first and bottom-first, 
although both may be iterative. 

In a top-first middle-out methodology, 
studies are first performed to modify the 
language and representation scheme to 
make them more adaptable to the archi¬ 
tecture and computational model. Primi¬ 
tives may be added to the language to fa¬ 
cilitate parallel processing. Useful features 
from several languages may be combined. 
The design of the architecture follows. 

In the bottom-first middle-out method¬ 
ology, hardware support for the overhead¬ 
intensive operations enables the chosen 
language or representation scheme to be 
mapped directly into architecture and 
hardware. Applications are implemented 
by means of the language and representa¬ 
tion scheme provided. Lisp computers are 
examples of computers designed with the 
bottom-first middle-out methodology. 


The future 

To support efficient processing of AI 
applications, research must be done in de¬ 
veloping better AI algorithms, better AI 
software-management methods, and bet¬ 
ter AI architectures. 

The development of better algorithms 
could lead to significant improvement in 
performance. Many AI algorithms are 
heuristic in nature, and upper bounds on 
performance to solve AI problems have 
not been established as they have been in 
traditional combinatorial problems. As a 
consequence, the use of better heuristic in¬ 
formation, based on commonsense or 
high-level meta-knowledge and on better 
representation of the knowledge, could 
lead to far greater improvement in perfor¬ 
mance than an improved computer archi¬ 
tecture could provide. Automatic learning 
methods to aid designers to acquire and 
manage the new knowledge in a systematic 
manner are very important. 

Better AI software-management meth¬ 
ods are essential in developing more effi¬ 
cient and reliable software for AI process¬ 
ing. AI systems are usually open systems 
and cannot be defined on the basis of a 


closed-world model. The language must 
be able to support the acquisition of new 
knowledge and the validation of existing 
knowledge. Probabilistic reasoning and 
fuzzy knowledge may have to be sup¬ 
ported. The verification of the correctness 
of AI software is especially difficult owing 
to the imprecise knowledge involved and 
the random way of managing knowledge 
in a number of declarative languages and 
representation schemes. Traditional soft¬ 
ware-engineering design methodologies 
must be extended to accommodate the 
characteristics of AI applications. 

The role of parallel processing and in¬ 
novative computer architectures lies in im¬ 
proving the processing time needed to 
solve a given AI problem. It is important 
to realize that parallel processing and bet¬ 
ter computer architectures cannot be used 
to overcome the exponential complexity of 
exhaustive enumeration (unless an ex¬ 
ponential amount of hardware is used) 
and are not very useful in extending the 
solvable problem space. It is unlikely that 
a problem too large to be solved today by a 
single computer in a reasonable amount of 
time can be solved by parallel processing 
alone, even if a linear speedup can be 
achieved. The decision to implement a 
given algorithm in hardware depends on 
the complexity of the problem the algo¬ 
rithm solves and the frequency of the 
problem’s occurrence. Problems of low 
complexity can be solved by sequential 
processing or in hardware if they are fre¬ 
quently encountered; problems of moder¬ 
ate complexity should be solved by parallel 
processing; and problems of high com¬ 
plexity should be solved by a combination 
of heuristics and parallel processing. 

In many AI systems being developed to¬ 
day, tasks and operations implemented in 
hardware are those that are frequently exe¬ 
cuted and have polynomial complexity. 
These tasks and operations are identified 
by means of the languages or the knowl¬ 
edge-representation schemes supported. 
The architectural concepts and parallel¬ 
processing schemes applied may be either 
well-known conventional concepts or new 
concepts for nondeterministic and dynam¬ 
ic processing. The role of the computer ar¬ 
chitect lies in choosing a good representa¬ 
tion, recognizing tasks for maintaining 
and learning meta-knowledge that are 
overhead-intensive, identifying primitive 
operations in the languages and knowl¬ 
edge-representation schemes, and sup¬ 
porting these tasks and operations in hard¬ 
ware and software. 
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In this issue 

This special issue of Computer is a col¬ 
lection of articles describing a number of 
projects in this active area called AI 
computers. 

The first article, “Computer Architec¬ 
tures for Artificial Intelligence Process¬ 
ing,” by K. Hwang, J. Ghosh, and R. 
Chowkwanyun, is a survey of computers 
for AI processing. Existing efforts are 
classified as multiprocessors supporting 
MIMD operations, multicomputers sup¬ 
porting multiple SISD processing, and 
multipurpose computers operating in an 
SIMD, or multiple-SIMD, or MIMD fa¬ 
shion. The architecture, languages, execu¬ 
tion paradigms, and principal applications 
of various AI computers are summarized. 

The second article, “Software Devel¬ 
opment Support for AI Programs,” by 
C. V. Ramamoorthy, S. Shekhar, and V. 
Garg, presents the problems faced in de¬ 
signing the software-development envi¬ 
ronment so that it will support all phases 
of the software-development cycle of an 
AI program: requirement specification, 
design, implementation, testing, and 
maintenance. The evolution of support 
for development of AI programming is 
described with respect to discrete tools, 
toolboxes, life-cycle support, knowledge- 
based tools, and intelligent life-cycle sup¬ 
port environments. 

The third article, “Symbolics Architec¬ 
ture,” by D. A. Moon, details the design 
philosophy of and trade-offs in the Sym¬ 
bolics Lisp computers. Three levels of the 
architecture—system architecture, in¬ 
struction architecture, and processor ar¬ 
chitecture—are discussed. 

The next two articles discuss systems 
for the support of object-oriented 
programming. 

The fourth article, “The Architecture 
of FAIM-1,” by J. M. Anderson, W. S. 
Coates, A. L. Davis, R. W. Hon, I. N. 
Robinson, S. V. Robison, and K. S. 
Stevens, presents the design of FAIM-1, a 
concurrent, general-purpose, symbolic ac¬ 
celerator for parallel AI symbolic compu¬ 
tations. The OIL language supported by 
FAIM-1 has object-oriented, logic-pro¬ 
gramming, and procedural-programming 
features. 

The fifth article, “What Price Small¬ 
talk?” by D. Ungar and D. Patterson, 
discusses the design of a Reduced Instruc¬ 
tion Set Computer for Smalltalk-80. The 
requirements of the Smalltalk-80 pro¬ 
gramming environment and the valuable 
lessons learned by implementing clever 


ideas in hardware that does not signifi¬ 
cantly improve overall performance are 
presented. 

The sixth article, “Initial Performance 
of the DAD02 Prototype,” by S. J. Stol- 
fo, presents the design trade-offs of, im¬ 
provements achieved by, and measured 
performance of DAD02, a parallel¬ 
processing system for evaluating produc¬ 
tion rules and other almost-decomposable 
search problems. 

The last two articles are concerned with 
architectures for support of knowledge- 
representation schemes. 

The seventh article, “Applications of 
the Connection Machine,” by D. L. 
Waltz, discusses the architecture and ap¬ 
plications of the Connection Machine, a 
system with massive parallelism. A 
number of applications, including docu¬ 
ment retrieval, memory-based reasoning, 
and natural-language processing, are 
presented. 

The eighth article, “Connectionist Ar¬ 
chitectures for Artificial Intelligence,” by 
S. E. Fahlman and G. E. Hinton, presents 
the designs of both NETL, a marker-pass¬ 
ing system implementing semantic net¬ 
works, and value-passing systems (which 
the authors exemplify by the Hopfield and 
Boltzmann iterative networks) for con¬ 
straint satisfaction. 

Owing to page limitations, we were 
unable to include two other articles 
originally accepted for this special issue. 
One, “The Architecture of Lisp Ma¬ 
chines” by A. R. Pleszkun and M. J. Tha- 
zhuthaveetil, enumerates the runtime re¬ 
quirements of a Lisp system and identifies 
architectural requirements that must be 
met for good machine performance. The 
solutions to these requirements in a num¬ 
ber of Lisp machines are also discussed. 
The other, “Computer Architecture for 
the Processing of a Surrogate File to a 
Very Large Data/Knowledge Base,” by 
P. B. Berra, S. M. Chung, and N. I. Hach- 
em, shows the design and performance of 
a proposed back-end system to support 
the use of surrogate files in data/knowl¬ 
edge bases. The articles will appear in an 
upcoming issue in the near future. 

Despite the large number of articles in 
this special issue, it was not possible to 
cover many major projects in this area. I 
realize that there are many researchers, too 
numerous to mention individually, who 
have made notable contributions to the 
development of this area of research, and I 
apologize for any inadvertent omissions. 
Two collections of articles'’^ that I have 
compiled also provide reference sources 


for some of the published articles in this 
exciting area. □ 
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new generation of 
intelligent 

multiprocessors and 
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T his article assesses different archi¬ 
tectural approaches to the design 
of computers for artificial intelli¬ 
gence (AI) applications. We provide a 
classification scheme that highlights the 
relationship between the application do¬ 
mains and hardware realization of AI- 
oriented computer systems, as well as a 
comparison of AI machines and numerical 
computers. The emphasis is on three ar¬ 
chitectural classes: 

• multiprocessors that support interac¬ 
tive MIMD (multiple-instruction 
stream and multiple-data stream) 
operations thr ough a shared memory 
space, 

• multicomputers that support multiple 
SISD (single-instruction stream and 
single-data stream) operations by 
means of message passing among dis- 

tributed nrncessn rt with inr^ai 

memories, and 

multipurpose computers consisting of 
a large number of fine-grain 
processor-memory nodes operating in 
an SIMD (single-instruction stream 
and multiple-data stream), a multiple 
SIMD, or an MIMD fashion. ’ 

We will examine the architecture, lan¬ 
guages, execution paradigms, and prin¬ 
cipal applications of AI machines. This is 
not meant to be an exhaustive study of all 
reported systems. Instead, we summarize 
some representative systems containing 
unique and interesting features; these sys¬ 
tems can provide a state-of-the-art assess¬ 
ment of where we stand and where we are 
headed.We first assess symbolic process¬ 
ing requirements and Al-machine charac¬ 
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teristics. Then we present an architectural 
taxonomy of AI machines and examine 
each category in some detail. (Interested 
readers may refer to the tutorial Com¬ 
puters for Artificial Intelligence Applica¬ 
tions^ for other relevant articles.) 

Symbolic processing 
in AI 

The acquisition, representation, and in¬ 
telligent use of information and knowl¬ 
edge are fundamental to AI processing. 
An intelligent system should be able to ac¬ 
quire information from various external 
sources: v isual, vocal, and writt en. Input 
from these sources is often incomplete, 
imprecise, or even contradictory. Sym¬ 
bolic processing is required for proper 
recognition and understanding of graph¬ 
ics, images, speech, and text. This involves 
primitive operations, such as comparison, 
selection, sorting, pattern matching, and 
logical set operations, besides arithmetic 
and logic operations. 

Knowledge representation involves the 
encoding of information about objects, 
relations, goals, actions, and processes 
into data structures and procedures. The 
encoding should facilitate adding to, alter¬ 
ing, and manipulating knowledge. Promi¬ 
nent among current approaches to knowl¬ 
edge representation are semantic nets, 
frames, scripts, procedural representa¬ 
tion, production systems, predicate logic, 
and relational databases. 

Processing of knowledge is required for 
problem solving, making logical deduc- 
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Figure 1. Two approaches to designing Al-oriented computers. (Figure courtesy of 
Benjamin Wah and G. J. Li.®) 


tions, and information retrieval. The fun¬ 
damental operation involved is search. 
The searching techniques include state 
space traversal in OR graphs, problem re¬ 
duction for logic programs and AND/OR 
graphs, and graph search for semantic net¬ 
works. The efficiency of search can be im¬ 
proved by heuristic guidance and pruning. 
Typical methods for reasoning are resolu¬ 
tion for logic programs, forward and/or 
backward chaining for rule-based sys¬ 
tems, marker propagation for semantic 
networks, and procedural attachments for 
frames. Most of these methods demand 
intensive memory accesses and I/O ac¬ 
tivities rather than CPU operations. 

The characteristics of symbolic process¬ 
ing are thus fundamentally different from 
those of numerical processing. The main 
distinctions lie in symbolic knowledge rep¬ 
resentations, search-intensive operations, 
a large memory requirement without the 
locality-of-reference property, variable 
sizes of messages, the use of nondetermi- 
nistic algorithms, interactive I/O, and 
knowledge database requirements. 


Al-oriented computers 

Owing to the radical change in the 
nature of the application domain, many 
architectural features of conventional 


computers tuned for numerical applica¬ 
tions become either inadequate or super¬ 
fluous for efficient support of symbolic 
processing. A von Neumann architecture 
with centralized control presents a pro¬ 
cessor/memory bottleneck to intensive 
and irregular memory access patterns. 
Therefore, parallel and distributed pro¬ 
cessing of AI problems is desirable.^ 
Many AI algorithms are nondeterministic 
in nature, so dynamic resource allocation 
and load balancing are of major concern. 
Furthermore, the management of large 
knowledge bases results in a need for high 
I/O bandwidths and efficient interconnec¬ 
tions among processor/memory nodes.'’ 

As shown in Figure 1, the development 
of AI computers can be bottom-up, start¬ 
ing from the architectural features of the 
machine and working upwards to the ap¬ 
plications they can support efficiently. For 
example, a computer with special hard¬ 
ware for data retrieval, pattern matching, 
and unification might be expected to sup¬ 
port an inference system based on the 
logic-resolution principle. Alternatively, 
the design process can start with target ap¬ 
plications and progressively work down 
towards the architectural basis. Key issues 
encompassed by either method include the 
development of AI programming lan¬ 
guages, parallel algorithms, distributed 
operating systems and distributed prob¬ 
lem solving, knowledge acquisition and in¬ 


ference mechanisms, and intelligent man- 
machine interfaces. ® 

The choices made at each level of the 
hierarchy in Figure 1 are not necessarily in¬ 
dependent and exclusive.® For example, 
an expert system can be implemented so as 
to use both rule-based and resolution- 
based inferencing. Logic programs re¬ 
stricted to binary predicates can be viewed 
as forms of extended semantic networks, 
and then solved by means of graph 
search.’ Some architectures can support 
multiple languages and/or multiple modes 
of execution. Rediflow,® for example, 
uses both reduction and macro-dataflow 
execution. 

A taxonomy of AI 
machines 

The taxonomy shown in Figure 2 covers 
AI systems that are based on knowledge 
and language approaches, as well as intelli¬ 
gent I/O interface machines. These 
branches are expanded in three subtrees in 
Figures 3-5. Key references are given after 
the listed AI machines in these three 
figures. At present, only some Lisp ma¬ 
chines (Symbolics, LMI Lambda, TI Ex¬ 
plorer, Xerox 1100) and a few Al-oriented 
m achines (such as the Conne xion 
Ma^i^ ) have entered the marketplace. 

' All tiTT' others are exploratory systems 
under development at universities or at in¬ 
dustrial R&D laboratories—an indication 
of the youth and promise of this field. 

Language-based machines are designed 
to execute efficiently a computational 
model of some high-level AI language 
such as Lisp. They incorporate special 
mechanisms in hardware to implement 
primitive operations of the languages they 
support. Most systems listed in Figure 3 
are either uniprocessors or have a coarse- 
grain architecture (that is, they consist of a 
small number of fairly powerful proces¬ 
sors). The Lisp machines are stack- 
oriented and use a tagged architecture. 
Prolog machines need pattern search and 
unification as basic mechanisms so that 
they can make logical inferences based on 
the resolution principle. Architectures for 
functional languages use computational 
models, such as dataflow and reduction, 
which have asynchronous and distributed 
control. Therefore they can exploit a 
greater degree of parallelism than von 
Neumann computers using control-flow. 

Knowledge-based AI machines (Figure 
4) are governed by models for representa¬ 
tion and manipulation of knowledge. At- 
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Figure 2. Three major classes of AI computer architecture. 


Figure 3. Language-based AI machines. 


Language-based AI machines 

List-processing (Lisp) 

Prolog Functional programming 

machines 

1 

machines machines 

I I 

1 

Spur^2 

I I 

PIM (FGCS)’^ Rediflow® 

PIE’® ALICES’ 

Symbolics 3600 series^^ 

LMI Lambda^ 

PLM (Aquarius)’® C-Lisp Machine^® 

alpha!'’ 

Tamura Machine®® ZAPP®^ 

Xerox 1100 series^ 

Ffp®4 

Tektronix 4400 series’® 

Tl Explorer’® 

DFM®® 


Knowledge-based AI machines 

I 

Semantic networks 

I 

Rule-based 

I 

Object-based 

I 

-1 

Neural networks 

1 

NETL®® 

Connection Machine®® 
Thistle®® 

snap®® 

I 

DADO®® 

PSM®’ 

NON-VON®® 

I 

SOAR®® 
iAPX 432®® 
Dragon®® 
FAIM-1®® 
AI-32®® 

1 

Boltzmann®® 

Neural circuits®® 


Intelligent interface machines for 

Al-oriented systems 

1 

Speech recognition 

1 

1 

Pattern recognition/ 
image processing 

1 

Computer vision 

1 

Harpy4’ 

HEARSAY-11'” 

Dialog Systems ISOO^’ 
NEC DP-100“” 

IBM Natural Task'” 

Cytocomputer^® 

PIPE'W 

Pyramid44 

Tospics'*® 

Purnps^® 

Zmob'’® 

1 

WARP'’® 

Butterfly^® 

VICOM-VME'*® 


Figure 5. Intelligent interface machines. 


tempts at modeling the brain have inspired 
massively parallel computers that use 
thousands of processors, each having 
limited hardware and a small local storage 
capability, and functioning as an extreme¬ 
ly reduced instruction set computer 
(RISC). Such connectionist architectures® 
are based on computation models in which 
intelligent activity can be performed by the 
simultaneous execution of a large number 
of extremely simple operations in an 
MIMD/SIMD fashion. 

Knowledge can also be stored as inten¬ 
tional data (rules) and extensional data 
(facts), and manipulated by rule-based 
systems. Object-oriented systems use in¬ 
heritance to group together data/pro¬ 
cedures common to a class of logically 
related entities. Machines for speech 
recognition, image understanding, and 
computer vision (Figure 5) provide intelli¬ 
gent I/O interfaces for AI systems. Below, 
we characterize each class of AI machines 
separately, and we summarize architectur¬ 
al features and typical applications of 
some representative AI systems in Tables 
1-7. 

List-processing (Lisp) 
machines 

A Lisp program can be seen as a set of 
functions in which data is passed from 
function to function. The concurrent exe¬ 
cution of these functions forms the basis 
for parallelism. The applicative and recur¬ 
sive nature of Lisp requires an environ¬ 
ment that efficiently supports stack com¬ 
putations and function calling. The use of 
linked lists as the basic data structure 
makes an automatic storage allocation 
mechanism with efficient garbage collec¬ 
tion vital. AI programs such as MAC- 
SYMA, which consists of about 230K 
words of compiled Lisp code, need a large 
memory space. Conventional computers 
fail to meet the above requirements. They 


Figure 4. Knowledge-based AI machines. 


also do not recognize untyped data objects 
efficiently. Thus, fast execution of Lisp 
necessitates novel architectures tailored to 
its specific requirements. 

As can be seen from Table 1, most com¬ 
mercial Lisp machines have a unipro¬ 
cessor architecture with tagged memory. 
Notable exceptions are Lambda and TI- 
Explorer, which are centered around the 
very fast NuBus and are capable of sup¬ 
porting more than one processor. The 
Xerox 1108, 1100, and 1132 are personal 
workstations that support the InterLisp-D 
system, which is designed for exploratory 
development of AI programs. The Sym¬ 
bolics 3600 shifts more operations to hard¬ 
ware from microcode than its ancestors. 
The trend of increased hardware support 
is also seen in the ALPHA, which offers a 
low process-switching time for multiple 


processes through a virtual stack and an 
associative cache.Lisp machines are 
dealt with in more detail in an article 
scheduled to appear in an upcoming issue 
of Computer. ’' 

Prolog machines 

Logic-oriented AI machines based on 
resolution directly execute programs ex¬ 
pressed in a Prolog-like language. In the 
dataflow model, an intermediate dataflow 
language is interposed between the Prolog 
program and the physical hardware. A 
translator is required to map the Prolog 
programs into dataflow graphs before exe¬ 
cution. Table 2 summarizes implementa¬ 
tions of Prolog machines and includes in¬ 
stances of machines that cover both 
approaches. 
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Table 1. Commercial Lisp machines. 


Manufacturer and Model 

Year of 
Introduction 

Comments 

Xerox 1100 series 

1981 

Personal workstation supporting the Interlisp programming environment, 
with bytecode emulation facilities. 

Symbolics 3600 series 

1983 

Provides direct hardware execution of data type checking at runtime, garbage 
collection, and instruction pipeline with prefetch. 

Lisp Machines Inc. (LMI), 
Lambda 

1983 

Modularly expandable multiprocessor centered around a fast NuBus: provides 
almost unlimited virtual memory space. 

Fujitsu ALPHA 

1983 

Hardware support for multiple processes through virtual stacks augmented by 
a cache that stores stack addresses of free variables. 

Tektronix 4400 series 

1984 

Lower end workstations built around conventional Motorola 68010/20 
processors. 

Texas Instruments Explorer 

1984 

32-bit-NuBus-based open architecture, with a dedicated Lisp processor and 
multiprocessor expansion capabilities. 


Table 2. Prolog machines. 


Machine and Developer 

System Architecture 

Execution Paradigm; 

Parallelism used 

Status 

Parallel Inference 

Machine (PIM), 

ICOT, Japan. 

Loosely coupled 
multiprocessor. 

Logic (PIM-R)/Dataflow 
(PIM-D); AND, OR, unification 
parallelism. 

Under construction. 

Parallel Inference 

Engine (PIE), 

University of Tokyo. 

Loosely coupled 
multiprocessor/multicomputer. 

Logic: OR and unification 
parallelism. 

Under construction. 

Programmed Logic 

Machine (PLM), 

UC Berkeley. 

Uniprocessor with special- 
purpose stacks. 

Control flow; OR and unification 
parallelism. 

Under construction. 

Tamura Machine, 

Kobe University, Japan. 

Bus-based multiprocessor 
with master-slave control. 

Control flow: AND parallelism. 

Constructed. 


Table 3. AI machines for functional programming. 


Machine and 
Developer 

Architecture 

Execution Paradigm 
Granularity 

Language(s) 

Supported 

ALICE, 

Imperial College, 

London. 

Shared-memory multiprocessor 
connected by crossbar and two rings. 

Graph reduction 
(dataflow at low level), 
fine/medium granularity. 

Hope,^^ Parlog 

Lisp, Prolog 

Rediflow, 

University of Utah. 

Mesh-connected processor-memory 
nodes with dynamic load balancing. 

Graph reduction/macro¬ 
dataflow, with medium to 
coarse granularity. 

FEL« 

DEM, 

NTT, Japan. 

A dataflow multiprocessor that uses 
packet-switched multistage network 
and structure memory with lazy/ 
lenient cons mechanism. 

Dataflow, with fine and 
medium granularity. 

Valid 

C-Lisp Machine, 

University of Kyoto, 

Japan. 

Shared-memory multiprocessor with 
a master-slave control. 

Stack, with medium and 
coarse granularity (user 
specified). 

Concurrent Lisp 

FFP Machine, 

University of North Carolina. 

Binary tree of processors with 
memory at the leaf nodes. 

String reduction, with fine 
granularity. 

Formal Functional 
Programming Language 
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The execution of a Prolog-based pro¬ 
gram can be speeded up by exploiting vari¬ 
ous kinds of parallelism. AND parallelism 
refers to the simultaneous execution of 
logically AND-ed clauses. If two clauses 
have variables in common, then a success¬ 
ful unification requires such variables to 
be bound to the same set of values in both 
clauses. If unification for two clauses is 
attempted through two concurrent pro¬ 
cesses, then we have to check that the 
common variables have been bound con¬ 
sistently. This adds to an overhead that 
may cancel the time saved by a parallel 
execution of the two clauses. One solu¬ 
tion is to group AND-ed clauses in such a 
way that no variable occurs in more than 
one group. These groups can then be exe¬ 
cuted in parallel. 

Alternatively, AND-ed clauses with 
common variables can be chained together 
in producer-consumer relationships to 
speed up serial AND evaluation. This 
stream parallelism essentially involves 
macropipelining of common variables so 
as to obviate the need for consistency 
checking. The PIM-R*’ implements 
stream parallelism by means of message 
blackboards that hold the common vari¬ 
ables and lists of suspended processes. 

OR parallelism refers to the concurrent 
search for alternate solution paths. Most 
logic machines favor OR parallelism, 
which is nondeterministic and can yield 
multiple solutions. Here, no overhead is 
incurred in consistency checking of vari¬ 
able bindings. However, unrestrained OR 
parallelism can lead to a combinatorial ex¬ 
plosion in the number of active OR pro¬ 
cesses, and to the possibility of infinite 
loops. 

Finally, one can implement unification 
parallelism, which refers to the parallel 
matching of clauses in the Prolog database 
with the goal clause and to the parallel in¬ 
stantiation of variables to constant values. 
The PIM and PIE provide hardware for 
parallel matching of goal clauses to clause 
heads in the knowledge base, and also pro¬ 
vide for parallel instantiation of variables. 

Functional 

programming machines 

Table 3 summarizes some of the 
machines that have been proposed to sup¬ 
port functional languages. Most machines 
use a graph or list representation for both 
program and data. In demand-driven 
computation, a function can be evaluated 
only when it is needed by another function 


for which it is an argument. The data- 
driven approach evaluates a function as 
soon as all its arguments are available. 
Demand-driven evaluation requires more 
overhead than data-driven evaluation, but 
allows better control of parallelism, more 
selective evaluation, and a natural way of 
handling infinite structures. Practical ap¬ 
proaches tend to be hybrid: ALICE 
allows low-level data-driven execution of 
data-intensive segments within a frame¬ 
work of graph reduction. Languages such 
as Hope^^ and Parlog are compiled into a 
target language for direct execution on this 
machine. 

Proposed interconnection schemes for 
functional programming machines in¬ 
clude shared buses for the concurrent-Lisp 
processor, ring for the Tl-dataflow 
machine, tree for the FFP reduction 
machine, as well as the hypercube and 
hypertorus. ALICE has a two-level 
hierarchical system in which each top-level 
module consists of a cluster of transputers. 
The tree interconnection in the FFP ma¬ 
chine presents a bottleneck towards the 
root if locality does not hold, while the 
cluster approach has inflexible locality 
boundaries that decrease efficiency if 
structures are to be shared among clusters. 
The hypercube and hypertorus offer a 
richer interconnection scheme at increased 
hardware expense and more complicated 
dynamic routing. 

Many multiprocessor architectures for 
functional programming support fine- 
grain parallelism in programs. On such 
machines, nodes in the program graph 
represent simple processes that tend to be 
active for a short time and perform some 
simple transformation. A bus- or ring- 
based topology with adequate network 
bandwidth can provide an even distribu¬ 
tion of workload among the processors by 
means of simple allocation mechanisms. 
However, they do not take advantage of 


locality, and can rapidly degrade in perfor¬ 
mance if message traffic increases. The 
Rediflow reduces communications over¬ 
head by grouping several simple processes 
together and executing them as a sequen¬ 
tial process. Sugimoto’s machine for con¬ 
current-Lisp requires the programmer to 
specify parallelism explicitly. In both 
ZAPP^"* and Rediflow, the degree of par¬ 
allelism depends on the workload, since 
each processor has a list of local processes 
that can migrate to neighboring processors 
only if the difference in processor load is 
above a threshold. 


Parallel processing of 
semantic networks 

The goal of knowledge-oriented archi¬ 
tectures is to provide efficient execution of 
powerful models for the representation 
and manipulation of knowledge. Table 4 
presents some popular knowledge-repre¬ 
sentation schemes and reasoning tech¬ 
niques, and representative architectures 
associated with them. In a semantic net¬ 
work, nodes represent objects or con¬ 
cepts, and a link between two nodes signi¬ 
fies a specified relationship between the 
corresponding objects or concepts. Knowl¬ 
edge retrieval from a semantic net can in¬ 
volve searching the entire network. If the 
desired fact is not stored explicitly, it may 
have to be deduced from other stored infor¬ 
mation. Programs for knowledge retrieval 
often spend most of their time repeating a 
few basic operations, such as logic opera¬ 
tions on sets, sorting, pattern matching 
against a set of assertions, and deducing 
facts from semantic inheritance networks. 
Speedup can be obtained by simultaneously 
initiating these operations from many 
nodes of the network. Ideally, each concept 
(node) should be allocated to a distinct pro- 


Table 4. Knowledge representations and related AI machines. 


Knowledge Representation 

Reasoning T echnique 

Machine 

Predicate logic 

Resolution 

FGCS 

Data encapsulation 

Inheritance 

iAPX 432 

Production systems 

Forward chaining 

DADO 

Frame 

Procedural attachments 

Apiary 

Procedures 

Program execution 

Zmob 

Semantic network 

Marker propagation 

NETL 

Neural networks 

Energy minimization 

Boltzmann 
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Table 5. AI machines for production systems and semantic networks. 

System and Developer Architectural Features Languages Supported Principal AppUcations 


Connection Machine, 
Thinking Machines, Inc., 
Cambridge, Mass, 
(marketed, 1986), 


An SIMD machine with!simple Executes Connection 
processor/memory nodes inter- Machine Lisp (CmLisp). 
connected as a hypercube. 


Thistle, 

Carnegie Mellon Univer¬ 
sity, Pittsburgh 
(conceptual machine). 
DAD02, 

Columbia University 
(fabricated, 1986). 

SNAP, 

University of Southern 
California, Los Angeles 
(cor'''*ntual machine). 


Massively parallel fine-grained 
system that uses both value and 
marker passing mechanisms. 

A binary-tree structured 
multiprocessor of 1023 nodes 
operating in SIMD/MIMD/ 
multiple-SIMD modes. 

A 2D mesh of identical cells with 
content-addressable memory; 
combines associative and cellular 
array processing. 


Unknown 


Superset of PL/M, 
paredlel versions 
of C, Lisp. 

High-level instructions 
built upon a set of 
microinstruction 
primitives. 


Processing of knowledge 
represented by semantic net¬ 
works; other applications that 
can exploit fine-grained 
parallelism in traversing a 
search space. 

Semantic network processing; 
iterative relaxation for low-level 
vision. 


Expert systems implemented as 
production systems; speech 
recognition. 

Semantic-net processing; pro¬ 
duction systems; and discrete 
relaxation for vision. 


cessor and the interconnections between 
these processors should be flexible enough 
to represent the relationships between the 
corresponding concepts. 

This ideally requires a large number of 
processor elements with programmable 
logical connections so that the topology 
can be configured to suit the problem. If 
the silicon area is limited, the processors 
must be simple and have little local memo¬ 
ry, and the interconnection network 
should be regular. However, the memory is 
distributed throughout the machine and is 
more intelligent because it can modify 
itself in many places simultaneously 
through the local processors. The funda¬ 
mental inefficiency of the von Neumann 
memory, in which only a few locations can 
change state at any given time, is thus 
avoided. The above considerations are re¬ 
flected in proposed massively parallel, 
fine-grained architectures such as NETL 
and Thistle machines^* as well as in se¬ 
mantic net processors actually being built, 
such as the Connection Machine. The 
SNAP is an array-structured machine for 
processing semantic networks, and is spe¬ 
cially designed for VLSI implementation.^® 
The power of the Connection Machine 
stems from its ability to store information 
in the reconfigurable virtual interconnec¬ 
tion patterns of the cells, and to execute 
concurrently the same simple operation on 
a very large number of cells. It is claimed 
that the Connection Machine is also effec¬ 
tive for applications like object recogni¬ 


tion and unstructured text retrieval, which 
are not expressed in the semantic network 
framework, but require lots of searching 
and sorting. There is a profound change in 
the type of algorithms that are meaningful 
for use with this machine. For example, 
one may no longer need to presort a large 
set of data in the order in which it is 
needed, since the Connection Machine can 
sort its entire memory in 30 msec. 

Radical computer models that are pat¬ 
terned after neural networks are also being 
developed.®® Table 5 outlines some AI 
machines for processing semantic net¬ 
works^®”®® and some for implementing 
production systems.®'"®® 

Rule-based systems 

Expert systems like R1 and XSEL have 
been written as rule-based production sys¬ 
tems in specialized languages, such as 
OPS5.®' The basic algorithm for the 
execution of production systems goes 
through a three-phase rule-firing cycle. 
First, the condition clauses of all rules are 
“matched” against the working memory, 
which represents the state of the world. 
One of the successfully matched rules is 
then “selected” according to somecontrol 
strategy. Finally, in the “act” phase, the 
selected rule is executed or fired, and the 
working memory is updated. This is done 
in a serial fashion and is inherently very 
slow. 


Among the special architectures de¬ 
signed to speed up the execution are the 
DADO®® and the Production System 
Machine (PSM).®’ DADO uses a binary 
tree as the basic underlying interprocessor 
communication network. The internal 
tree nodes are used to store production 
system rules and elements of the working 
memory, while the root is used to select 
one of the successful rules and to broad¬ 
cast to the entire tree the resulting changes 
to be made. Speedup results from storing 
the state of the system in a distributed 
fashion, and by performing matches and 
state updates in parallel. The binary tree 
topology is favored because it can be effi¬ 
ciently implemented in VLSI technology, 
and can also easily handle broadcasts from 
the root to a large number of recipients. 
Since in the execution of production sys¬ 
tems, each node talks only with its ances¬ 
tors, the binary tree bottleneck is avoided. 

Object-based AI 
machines 

Object-oriented programming®"* is 
based on the encapsulation of data, 
together with all the procedures that 
manipulate it, into a uniform type—the 
object. Objects can only interact with one 
another by sending messages. A represen¬ 
tative language like Smalltalk-80 does not 
require type specification for variables, 
can link subroutines on-the-fly, and can 
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manage varying data structures dynami¬ 
cally. A reasonably fast implementation of 
such a language requires efficient hard¬ 
ware support for a high-level instruction 
set, dynamic data typing, frequent and 
expensive procedure calls, and an object- 
oriented storage management. 

These requirements are somewhat 
similar to those for Lisp machines. There¬ 
fore, it is not a big surprise that features 
such as parallel checking of data tags, a 
stack-oriented execution, and duplicate 
“shadow” register sets for fast trapping 
and procedure calls are incorporated in 
most object-oriented machines. Since ob¬ 
jects are created, modified, and destroyed 
frequently, and since they all reside in the 
same virtual memory, a large virtual 
memory space with dynamic storage allo¬ 
cation and efficient garbage collection is 
provided. An object-oriented storage also 
requires schemes for object protection and 
a mechanism for quick retrieval of objects 
from memory. Table 6 shows key features 
of object-oriented machines. 

The first commercially available object- 
oriented architecture, the Intel iAPX 432, 
was a complex instruction set computer 
(ClSC)-based multiprocessor.^* In con¬ 
trast, the SOAR project^* extended the 
RISC philosophy to an object-oriented 
programming environment by shifting the 
burden of managing objects and providing 
complicated operations to the software. 
The RISC approach is also taken for the 
Dragon, a 32-bit super-workstation being 
designed at Xerox Palo Alto Research 
Center. This tightly coupled system uses 
up to 10 identical processors, which access 
the main memory through a common bus. 


The bus interface is through fully associ¬ 
ative instruction and data caches. A 
floating-point accelerator for graphics and 
simulation applications is incorporated in 
each processor. 

The FAIM-1 is a multicomputer system 
designed to provide efficient hardware 
support for an object-oriented language 
called OIL, in which atomic objects can be 
expressed in a logical or procedural 
fashion.^® A distinctive feature of this 
project is the transfer of many functions 
from software to hardware contained in 
specialized memory subsystems. These 
units relieve the processor from many of 
the storage management duties, which are 
typically very time-consuming in AI appli¬ 
cations. Excluded from Table 6 are object- 
based systems that are implemented in 
software and run on Lisp machines, and 
more general-purpose machines, such as 
the Intel iPSC, whose memory-enhanced 
version is supporting MACE, a testbed for 
distributed AI problem solving. 


Intelligent I/O interface 
machines 

AI systems often provide speech analy¬ 
sis, natural-language understanding, 
image processing, and computer vision as 
intelligent interfaces between man and 
computers. While proposed schemes for 
natural-language understanding are im¬ 
plemented in software at present, com¬ 
puter architectures have already emerged 
to support speech-understanding^* and 
image-understandingapplications. 


Some of these systems are highlighted in 
Table 7. These systems are not pure sym¬ 
bolic processors. In fact, low-level pro¬ 
cessing of speech and images involves sub¬ 
stantial numerical calculations: processing 
of symbolic representations of phonemes 
and images is carried out at higher levels. 
The Cytocomputer"*^ has an interesting 
pipeline architecture specially designed for 
biomedical image processing. The Warp'*^ 
is based on a programmable systolic array. 
It is specially designed to provide com¬ 
puter vision for an autonomous vehicle. 

Zmob'** and Butterfly'*^ are examples 
of systems that can perform both symbolic 
and numerical processing. Both of them 
use up to 256 identical microprocessors 
each for concurrent, distributed com¬ 
puting. As in the Connection Machine, the 
main cost of these two systems is in the 
communication networks. The Zmob 
connects its Z80-based processing nodes 
through a fast slotted-ring to achieve a 
total data-in-motion rate of 14G bytes per 
second for a configuration with 256 pro¬ 
cessors. The local memories of the But¬ 
terfly collectively form a globally shared 
memory space. A processor can access 
another processor’s memory via the but¬ 
terfly network. Typically, it takes about 
two microseconds to complete a local 
memory access and about six microsec¬ 
onds to access a remote memory by means 
of the network. The Butterfly machine is 
especially attractive for solving large-grain 
problems that demand general intercon¬ 
nects among the processors. The Connec¬ 
tion Machine also supports general con¬ 
nect, but it is more tuned towards fine- 
grain problems. 


Table 6. Object-oriented AI machines. 


Name and Developer Architecture, Language Supported 


Execution Paradigm 


Status 


iAPX 432, 

Intel Corp. 

Multiprocessor-expandable around 
shared bus; for Ada and “purer” 
object-oriented languages. 

Both stack and three address 
instructions executed. 

SOAR, 

UC Berkeley. 

Uniprocessor for Smalltalk. 

Register-based expression 
evaluation with dynamic type¬ 
checking using tags. 

FAIM-1, 

Fairchild, Palo Alto, 
Calif. 

Multiprocessor with hexagonal mesh 
topology; executes OIL. 

Stack-based, with parallel tag¬ 
checking hardware. 

Dragon, 

Xerox, Palo Alto, 
Calif. 

Tightly coupled multiprocessor that 
uses a common bus; supports Cedar, 
Interlisp and Smalltalk. 

Executes both stack and 

memory-to-memory 

instructions. 

AI-32, 

Hitachi, Japan. 

Microprogrammable uniprocessor; 
supports Smalltalk and others. 

Stack-based with tagged 
operands. 


Marketed in 1981. 

Implemented on a chip, 
1984. 

Under construction. 

Under construction. 

Implemented on a chip, 
1986. 
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Table 7. Intelligent interface machines for AI systems. 


System and Developer 

Harpy Machine, 

Carnegie Mellon University, 
Pittsburgh. 

Butterfly, 

BBN, Inc., 

Cambridge, Mass. 

Warp, 

Carnegie Mellon University, 
Pittsburgh. 

PIPE, 

National Bureau of Standards, 
Washington, DC. 

Pyramid, 

University of Washington, Seattle. 


Architectural Features Applications Status 

Multiple microprocessors accessing Speech recognition. Implemented, uses 

shared memory through common five microprocessors, 

bus. 1979. 

An MIMD machine consisting of up Computer vision, VLSI Marketed in 1985. 

to 256 processor/memory nodes in- simulation, cognitive 
terconnected through a butterfly modeling, numerical 
switching network. applications. 

A linear systolic array of program- Image processing, vision 10-processor system 

mable processors. for autonomous vehicles. operational, 1986. 

Pipelined processor with identical Front-end processor for Modules built, 1985. 
modular stages operating in SIMD low-level image processing, 
or restricted MIMD mode. 

A pyramid of multilayered array Image processing, spatial Prototype with 85 

processors. problem solving, graphics, processing elements 

under development, 
1985. 
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A t present, most AI machines are 
exploratory in nature and are still 
in the research and development 
stage. Hardly any performance statistics 
are available for these projects. Coarse- 
grain parallel processors are presently used 
in most numerically oriented supercom¬ 
puters. Fine-grain multiprocessors or mul¬ 
ticomputers have potential for both nu¬ 
merical and symbolic computations. We 
observe a shift towards highly parallel ar¬ 
chitectures as hardware costs keep de¬ 
creasing, together with a shift of functions 
from software to hardware, and the emer¬ 
gence of intelligent memories obtained by 
incorporating processing logic into 
memory units. The conventional separa¬ 
tion of processor and memory is getting 
blurred. In the computer market, super¬ 
workstations and mini-supercomputers 
with some degree of AI capability are 
emerging as commercial products. To inte¬ 
grate both numerical and symbolic pro¬ 
cessing into a single system will be very dif¬ 
ficult because of the conflicts in processing 
requirements. The AI machine designer 
must be aware of these conflicting goals. 
To guarantee higher performance, AI 
machines have to be treated as special- 
purpose computers with the architectural 
features discussed in this article. 

The development of high-performance 
and highly intelligent AI machines will be 
evolutionary rather than revolutionary. 
The challenges must be met by building on 
solid foundations of artificial intelligence, 
software engineering, computer architec¬ 


ture, VLSI technology, expert systems, 
speech recognition, computer vision, net¬ 
working and supercomputers.Ad¬ 
vances in these areas will help develop the 
next generation of computers. Future ef¬ 
forts in developing highly parallel systems 
for AI applications should focus on con¬ 
current programming languages and their 
compilers, distributed software environ¬ 
ments, effective knowledge representation 
and manipulation, fast nondeterministic 
search techniques, intelligent I/O inter¬ 
faces, better matching between parallel 
hardware architectures and parallel AI al¬ 
gorithms, and the exploration of new tech¬ 
nologies, such as neural computations 
and optical computing. Without major 
breakthroughs in these areas, AI machines 
will be far from being perfected. It may 
take more than one generation of humans 
to produce the next generation of super- 
intelligent computers. The authors suggest 
that multinational cooperative efforts be 
launched to reduce the development over¬ 
head and to avoid unnecessary mistakes 
and conflict of interests. □ 
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A rtificial intelligence is a growing 
branch of computer science that 
studies ways of enabling com¬ 
puters to do tasks that seem to require 
human intelligence. These tasks include 
game playing, expert problem solving, 
natural language understanding, and 
theorem proving. Many existing Al pro¬ 
grams perform such tasks with varying 
degrees of success. Whereas a program 
that can understand natural language is 
still a dream, many chess-playing pro¬ 
grams can beat expert human players. 

More successful Al programs include 
knowledge-based expert systems that are 
being applied to a wide spectrum of real- 
life problems from airline catering to oil 
exploration. These systems can acquire 
knowledge about a domain from a human 
expert and then use it to solve routine 
problems in that area. For example, expert 
systems can perform almost as well as 
human experts in the diagnosis of infec¬ 
tious diseases (MYCIN), finding the struc¬ 


ture of chemical compounds (DEN- 
DRAL), and performing mathematical 
symbol manipulations (MACSYMA). 
These Al systems offer new capabilities to 
tackle several problems difficult to solve 
using the conventional algorithmic 
approach. 

However, some difficulties exist in using 
Al techniques for solving real-world prob¬ 
lems. The AI programming style differs 
markedly from that of conventional lan¬ 
guages such as Fortran or Pascal. Because 
of this, we face a shortage of AI program¬ 
mers and experts. The problem is ag¬ 
gravated by the fact that each area of AI 
has its own programming style, often un¬ 
suitable for other applications of AI. Also, 
the development of AI programs typically 
requires a software development environ¬ 
ment that supports all phases of the soft¬ 
ware life-cycle: requirements specifica¬ 
tion, design, implementation, testing, and 
maintenance. Existing Al development 
environments support just the implemen- 


Table 1. What makes AI programs different. 

Feature 

AI Programming 

Conventional Programming 

Processing type 

Symbolic 

Numeric 

Technique 

Heuristic search 

Algorithmic 

Definition of solution steps 

Not explicit 

Precise 

Answers sought 

Satisfactory 

Optimal 

Control/Data separation 

Separate 

Intermingled 

Knowledge 

Imprecise 

Precise 

Modification 

Frequent 

Rare 
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tation phase, which results in less reliable 
and hard-to-maintain programs. 

In this article, we discuss software de¬ 
velopment environments for AI programs 
to deal with these difficulties. An ideal 
software development environment 
should provide a powerful language for 
the application, as well as appropriate 
methodology and tools for program devel¬ 
opment. This article introduces popular 
AI languages and describes how their 
features have been combined in expert sys¬ 
tem shells to provide a powerful language. 
We also present an overview of the evolu¬ 
tion of tools for AI programming. The 
evolution is divided into five classes: 
discrete tools, the toolbox, life-cycle sup¬ 
port, knowledge-based tools, and the in¬ 
telligent life-cycle support environment. 

Present commercial AI program devel¬ 
opment support environments fall into the 
toolbox class, and they will have knowl¬ 
edge-based tools and life-cycle support for 
AI programs in the near future. 

Inside an AI program 

AI programs differ from conventional 
algorithmic programs. The latter often 
have a fixed sequence of steps defined 
precisely by the programmer, whereas AI 
programs, like human beings, often take a 
trial-and-error approach to finding a 
satisfactory solution. Table 1 lists some of 
the differences between conventional pro¬ 
grams and AI programs. 

The essence of AI lies in encoding 
knowledge about a domain and then using 
it to solve problems in that domain. This 
task is usually broken into three parts: 
knowledge representation for encoding in¬ 
formation about the domain, pattern 
matching for retrieving knowledge rele¬ 
vant to the problem, and searching for a 
satisfactory solution among a large num¬ 
ber of possibilities. 

We now discuss these basic components 
of AI programs. 

Knowledge representation. The amount 
of knowledge needed for any interesting 
AI application tends to be very large, and 
therefore to access, update, and maintain 
such large amounts of knowledge, AI pro¬ 
grams need good knowledge representa¬ 
tion schemes. AI researchers have used 
Prolog clauses, semantic networks, frames 
(see Figure 1) and many other schemes for 
representing knowledge, each having its 
advantages and disadvantages. For exam¬ 
ple, a semantic network keeps the related 
information together, but has difficulty in- 


Suppose we want to represent: 


John gave a pen to Mary. 
John is a friend of Mary. 


Prolog 1 

give Gohn, mary, pen) 
friend (john, mary) 

person Gohn) 
person (mary) 
physical_object (pen) 


Semantic Network 



SS: Superset 
Ei: Element 
Argi: Argument 1 
Arg2: Argument 2 


Frames 



Name 

G1 


Name 

John 


Name 

Pen 



Type 

Give-event 


Type 

Person 


Type 

Phy-Ob] 



Agent 

John 


Address 

• 


Colour 

. 



Recipient 

Mary 



. 


Weight 

. 



Object 

Pen 


• 

• 



. 












Name 

FI 


Name 

Mary 




Type 

Friend-of 


Type 

Person 




Argi 

John 


Address 

. 




Arg2 

Mary 


. 

. 




• 



• 

• 




Figure 1. Knowledge representation schemes: (a) Prolog, (b) semantic network, 
(c) frames. 


January 1987 



















































































































ferring from it. Prolog, on the other hand, 
has mechanisms for logical deduction, but 
does not keep related information together. 

Most traditional AI schemes, however, 
are suitable only when all the knowledge is 
in main memory. If the knowledge base 
grows too large to fit in the main memory, 
then disk-based databases have to be used. 
The design of efficient databases to store 
rules, objects, frames, etc. is still in the 
research stage. 

Pattern matching. AI language inter¬ 
preters use sophisticated pattern matching 
for selecting relevant rules at any stage of 
problem solving. Prolog systems match 
(unify) the current goal against various 
facts and rules in the database for invoking 
pertinent rules. The unification algorithm 
checks for equality of atoms and bound 
variables and tries to bind free variables to 
the value being matched against. More 
sophisticated matching, as in OPS5, 
allows condition evaluation to check if the 
current state of global memory satisfies the 
specified condition. The conditional ex¬ 
pressions can include relational operators 
such as equality and less-than, as well as 
connectives such as AND, NOT, and OR. 

Searching. AI programs choose from 
the set of all possibilities (search space) the 
most promising one to pursue for the solu¬ 
tion. To reduce the amount of search, AI 
programs use heuristics. Like rules of 
thumb, they often succeed but may fail 
occasionally. 

AI programming 
paradigms and 
languages 

A programming paradigm is a set of 
related concepts useful in conceptualizing, 
analyzing, and solving a problem. A pro¬ 
gramming language is a medium in which 
one or more paradigms can be expressed. 
For example, object-oriented program¬ 
ming is a paradigm, whereas Smalltalk is a 
programming language based on that 
paradigm. 

In this section, we summarize some 
popular AI programming paradigms by 
presenting for each a programming lan¬ 
guage based on that paradigm. We also 
discuss efforts to provide a homogeneous 
combination of multiple paradigms in a 
single programming language. Finally, we 
discuss some new developments that will 
affect the design of future AI languages. 


Lisp: Functional paradigm. A Lisp pro¬ 
gram consists of independent functions, 
each a mapping rule that translates its ar¬ 
guments to a result. These functions are 
created by composing system functions or 
user-defined functions using control struc¬ 
tures such as if and recursion. System 
functions include list processing primitives 
such as car, cdr, member, and append: 
mathematical primitives such as add, 
times, and division: and Boolean predi¬ 
cates such as and, negation, and equal. 

Another underlying structure used in 
Lisp is list. Lisp provides functions to con¬ 
catenate, build, extend, and dissect lists. 
Some examples of lists are (ON TABLE 
BOOK) and (ADD 3 (ADD 4, 8)). 

Another example of a Lisp function is 
given in Figure 2a. Because both data and 
functions are represented as lists, one can 
write Lisp functions to manipulate other 
functions. 

There are a number of versions of Lisp 
in use today. MacLisp, developed at MIT, 
is noted for efficiency, while Interlisp of 
Xerox Corporation has the most sophisti¬ 
cated program development environment. 
Common Lisp and Franz Lisp are other 
popular versions. We will take a look at the 
Interlisp environment later. 

Prolog: Logic programming. Logic 
programming is usually based on a 
theorem prover, which can tell us if a given 
set of logical formulas has any contradic¬ 
tion or not. A Prolog program may be 
viewed as a collection of formulas in prop¬ 
ositional logic with a theorem (query) to be 
proved. Formulas are restricted to im¬ 
plications, where each side of an implica¬ 
tion is a restricted logical expression. They 
are used to represent various facts (data) 
and rules of implication. An example of 
facts and rules is given in Figure 2a. 

Prolog provides a database facility to 
store facts and rules for efficient manipu¬ 
lation. A Prolog interpreter uses pattern 
matching, called unification, to select rele¬ 
vant rules from the database to answer a 
particular query. The user does not have to 
specify the exact sequence of steps to carry 
out a computation. This mechanism helps 
in programming natural language inter¬ 
faces because rules of language grammar 
fit easily into Prolog syntax. Because Pro¬ 
log is younger than Lisp, none of its pro¬ 
gram development environments are as 
good as that of Interlisp. 

OPS5: Production systems. An OPS5 
program consists of two parts: a global 
memory and a set of rules. The global 


memory can store data structures, which 
are referenced and manipulated by rules. 
Each rule has a left-hand side composed of 
a set of condition elements and a right- 
hand side that specifies actions (see Figure 
2b). If all the condition elements of a rule 
match the contents of global memory, 
then the rule is applicable. The OPS5 in¬ 
terpreter in a recognition-action loop 
selects all applicable rules and uses a 
criterion known as the conflict resolution 
strategy to chose one rule from among 
them. This strategy often depends on exe¬ 
cution time parameters, thus making it 
difficult to predict the behavior of the pro¬ 
gram statically, but it has the advantage of 
making unplanned responses possible. 

Production system languages such as 
OPS5 are generally unsuitable for coding 
algorithms, since it is difficult to do itera¬ 
tion and recursion in them.' Also, OPS5 
rules are independent of each other and 
cannot be grouped together as a set of 
related rules in a module, making the de¬ 
velopment of large programs difficult. 

Smalltalk: Object-oriented style. In this 
paradigm, a program consists of objects 
and messages. This way of programming 
brings modularity in the program by data 
abstraction and is especially suited to those 
situations with a clear hierarchical classifi¬ 
cation of objects. 

Smalltalk introduces two new concepts 
in programming: data abstraction and in¬ 
heritance. Data abstraction refers to the 
encapsulation of the data-structure defini¬ 
tions with procedures that can directly 
manipulate the representation of the data. 
All other procedures have to send a 
message to this object to access or update 
the data stored in it. 

The concept of inheritance is useful in 
representing knowledge about a hierar¬ 
chical classification. For example, con¬ 
sider the taxonomy used by biologists for 
living things. The class of humans is a 
subclass of mammals, hence it suffices to 
store the properties related to mammals in 
one place, with the understanding that all 
instances of humans will inherit the prop¬ 
erties of the superclass mammals. This 
representation also avoids inconsistencies 
arising from duplication of the same infor¬ 
mation in several places. 

Others. Several other programming 
models are used by researchers in AI. The 
augmented transition network parser used 
in natural language research implements 
grammar rules for the English language. 
The ATN parsers are top-down parsers 
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Lisp : Functional Paradigm 

(define is-ancestor (personi person2) 

(cond ({is-parent personi person2) true) 

((either (is-ancestor personi (father-of person2)) 

(is-ancestor personi (mother-of person2)) ) 

true))) 

Prolog : Logic Programming 

parentQohn, mary). ;a fact 

; rules 

ls_Ancestor (Personi, Person2):- Parent (Personi, Person2). 
ls_Ancestor (Personi, Person2) :- 

(a) Parent (Persona, Person2), Is-Ancestor (Personi, Persons). 

OPS5: Production Systems 

global memory elements: 

(time 

‘date; day, month and year 
‘hours ) hour of the day 
(walkman-sales 

‘make ; manufacturer 
‘model; model of the Walkman 
‘figure) sales-figure for the model 


productions (rules): 

(p sales-report 

(time ‘date TODAY ‘hours 5pm) 

(walkman-sales ‘makesony ‘model <model> ‘figure <sales>) 

— > 

(write (crif) The sales figure for Sony model <model> is <sales>) 


Figure 2. Glimpses of various programming languages, (a) The is-ancestor function 
takes two arguments and returns true if Personi, the first argument, is an ancestor of 
Personi, the second argument. The Prolog program for the same purpose would do 
something extra. It can also find-out all ancestors of Personi, or all descendants of Per¬ 
soni. (b) This sales-report rule will be activated at 5pm every day. It will print the sales 
figure for all models of Sony Walkman. The names surrounded by angle brackets (< and 
>) are variables and the names prefixed by ‘ are slot-names. 


with the facilities of special variables, con¬ 
ditions, and actions to aid in programming. 

A program for this system consists of a 
set of grammar rules and associated 
statements to be carried out when a gram¬ 
mar rule is applied. Frame-based systems 
have some features of the object-oriented 
style as well as those of production sys¬ 
tems. Each frame represents knowledge 
about a stereotypical situation. During 
execution, the current state can be 
matched against one part of a frame to 
check if that frame is applicable. The 
frame consists of an action to be taken and 
other conditional checks to see tljat the ac¬ 
tion has been performed correctly. The 
paradigm has been used successfully in 
understanding stories about certain ster¬ 
eotypical situations. 

Towards an amalgam 

Each of the several programming lan¬ 
guages in AI was designed with a set of 
specific problems in mind. Each features 
some interesting and useful constructs for 
helping to solve those problems. For ex¬ 
ample, Prolog and ATN are more conve¬ 
nient for developing parsers for a subset of 
English than, say, Lisp. 

This multiplicity of languages, however, 
poses several problems. It makes it dif¬ 
ficult for people to share their work and 
development tools. They also have to learn 
a new language whenever they try to ex¬ 
plore a new problem domain. In view of 
this, recently three commercial systems, 
namely KEE, ART, and LOOPS, have 
tried to combine some features from ob¬ 
jects, frames, rules, etc. They provide an 
integrated set of tools to allow multiple 
paradigms in the same program. These 
systems, called expert system shells, con¬ 
centrate on the programming needs for 
building knowledge-btised expert systems. 

KEE, LOOPS, and ART. The Knowl¬ 
edge Engineering Environment^ from In- 
tellicorp is a frame-based system built on 
top of Lisp. Frames represent both objects 
and rules and can be linked together to 
group them in a hierarchical manner. 
Frames consist of slots describing at¬ 
tributes of objects, constraints on their 
values, source of inherited values, proce¬ 
dure to be invoked when these attributes 
are accessed or updated, and rules affected 
by those objects. Lisp functions represent 
procedures, and predicate calculus repre¬ 
sents production rules and relations be¬ 
tween various objects. Figure 3 shows the 


knowledge base for a particular process 
control application. This hierarchically- 
organized knowledge base has a mix of 
rules, frames, etc. 

A deductive retrieval facility named 
TellAndAsk ^ provides a Prolog-like inter¬ 
face for accessing the knowledge base. 
Prolog-like logic programming is also used 
for rules interpretation. The rule system 
provides some tools for debugging and ex¬ 
planation. A rule class graph shows con¬ 
flicting rules that can be invoked for the 
same goal. A Ho w graph shows the deriva¬ 
tion tree for any conclusion. 

LOOPS (from Xerox PARC),'*’^ a sys¬ 
tem built on top of Interlisp-D, combines 
the functional paradigm of Lisp, the 
object-oriented style, and rules. LOOPS 
represents data structures and rules as ob¬ 
jects. It introduces the concept of compo¬ 
sition of rules by allowing a rule to call 
other rules directly or by sending mes¬ 


sages. Similarly, objects can be combined 
or grouped together to form higher-level 
objects. Procedures defined inside an ob¬ 
ject can be rules or Lisp functions. Inter¬ 
lisp tools have been upgraded to provide a 
uniform set of tools for the mixed 
paradigm. 

The ART system* from Inference 
Systems combines frames, rules, and pro¬ 
cesses. It represents facts by logical asser¬ 
tions or frames. For activities involving 
inferences and consequences, it uses a 
rule-based paradigm. 

ART also introduces the concept of a 
process that can incorporate rules and pro¬ 
cedures with internal control information 
for independent computations. 

The future. Present efforts toward inte¬ 
grating useful concepts of all paradigms 
can be useful only as short-term measures. 
Various important developments in Al 
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1960’s to mid-1970’s 


Figure 4. Classification of development environments. 


need to be incorporated in these amal 
gams. Some of these developments in¬ 
clude representation of belief, cooperating 
distributed AI systems, and disk-based AI 
systems.^ The representation of belief 
helps in decision-making situations, where 
some of the evidence is in favor of a hy¬ 
pothesis and some against. The uncertain¬ 
ty of this situation is quite common in real 
world problems such as medical diagnosis 
(MYCIN) and oil exploration (Prospector). 

It is difficult for a tightly integrated sys¬ 
tem to incorporate all the new features. We 
would rather see an open architecture, 
which can accommodate newer para¬ 
digms, as the choice of the future. 


Development support 
for AI programs 

The purpose of development support is 
to facilitate the creative and intellectual 
step from the conception of an idea to its 
description in a computer-understandable 
form. Peculiarities of tools, programming 
languages, and user interfaces often pre¬ 
sent a formidable problem to the user: The 
user has to spend more time translating an 
idea into a computer language than polish¬ 
ing the idea to improve it. This situation is 
unfortunate, and development support 
should try to relieve the user from as many 


details as possible and permit concentra¬ 
tion on the idea. 

The evolution of development support 
technology can be classified into five 
distinct parts as shown in Figure 4. 

Tools. Development tools have been 
around for a long time. Translators of 
programming languages and debuggers to 
monitor the execution-time state of pro¬ 
grams were some of the first tools. Debug¬ 
gers, along with screen editors, remain the 
most useful tools even now.® Other 
popular tools include pretty printer, con¬ 
figuration control support, program cross 
referencer, and execution profiler. 

These tools were discrete and indepen¬ 
dent. The programmer could access only 
one tool at a time. For example, during 
debugging you had to use the debugger to 
identify a bug and then terminate debug¬ 
ging to invoke the editor for fixing the 
bug. After this, you would have to compile 
your program and call the debugger for 
further debugging (the edit-compile-run 
cycle). It forced the programmer to type in 
extra commands and wasted time in start¬ 
ing and terminating system tool execution. 
Interrupting the debugging process to edit, 
recompile, and rerun the program severely 
hampered the thinking process of the 
programmer. 

Toolbox. The next development in sup¬ 
port environments was an integrated set of 
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tools called the toolbox. Each tool was 
designed with others in mind, therefore 
the system provided features to access 
other tools from inside the executing tool. 

For example, Interlisp allowed a pro¬ 
grammer to run a function (program) right 
after typing it into the system. In response 
to an error, the system invoked the debug¬ 
ger to allow the programmer to investigate 
the cause of trouble. The programmer 
could then edit the function and continue 
execution. This approach reduced the time 
needed for fixing minor errors in the pro¬ 
gram for the exploratory programming 
(trial and error) commonly used by the AI 
community. 

The Unbt system provided a relatively 
loosely-integrated set of tools for a wider 
range of functionality. The editor could be 
called from inside the debugger, but the 
programmer still had to recompile and 
rerun the program. Unix also presented a 
wide array of tools for data manipulation 
(grep, wc, head, more, awk, join etc.), 
rapid prototyping (csh, awk, pipe, I/O 
redirection), configuration management 
(make, ar, awk) and many other such 
routine operations. 

Life-cycle support in software engi¬ 
neering. The design of a large software sys¬ 
tem is a complex and difficult problem. 
The division of its life-cycle into several 
phases (requirement analysis, specifica¬ 
tions, design, implementation, testing and 
debugging, operation and mainte¬ 
nance®'*') is aimed at reducing the com¬ 
plexity of design by isolating and ordering 
the important tasks in the development 
process. 

We discuss each phase of the life-cycle 
later. Here we simply want to note that 
Unix and Interlisp support only the im¬ 
plementation and debugging phases. 
Studies show that the largest cost of the life 
cycle comes from the maintenance phase. 
Similarly, the requirement and specifica¬ 
tion phase tools are important, since any 
errors in specifications may be very dif¬ 
ficult and expensive to correct in later 
stages of the life-cycle. Thus, life-eycle 
considerations are important for any piece 
of software that is going to be used for an 
appreciable length of time by end users. 
Although the life-cycle model for most ex¬ 
perimental AI programs differ, the issues 
remain somewhat similar. 

Few programming environments pro¬ 
vide support for the entire life-cycle. Gan- 
dalf,*^ Genesis,and Saga'** represent 
efforts in this direction. 


Intelligent tools. The recent success of 
AI techniques in several areas motivated 
the use of AI techniques in the devel¬ 
opment of software. The Programmer’s 
Assistant project at MIT and the Psi proj¬ 
ect at Stanford University are two repre¬ 
sentative systems. These projects try to 
model the knowledge a programmer uses 
in understanding, designing, implemen¬ 
ting, and maintaining a program. This 
knowledge can be used by expert systems 
to partially automate the program devel¬ 
opment process. 

AI techniques are also being used to 
automate certain optimization decisions, 
like data-structure seleetion. We will 
describe this approach in more detail later. 

Future intelligent life-cycle support. 

Program development environments in 
future will provide knowledge-based tools 
for life-cycle support. AI techniques will 
support different phases of program de¬ 
velopment. The Rome Air Development 
Center Report*^ described knowledge- 
based tools for developing and validating 
requirements for any user program. The 
fifth generation projectincludes plans 
to provide intelligent life-cycle support. 

We now follow our abstract view of sup¬ 
port systems with a look at reality. 


Tools from Prolog 
environments 

This section describes some of the devel¬ 
opment tools available for Prolog pro¬ 
gramming. The tools have been taken 
from various versions of Prolog, including 
the Prolog-10 family, *^ Poplog, ** Miero- 
Prolog,*®and APES.^o 

Explanation. The explanation of any 
conelusion (result) derived by the system is 
the sequence of rules and facts used to 
reach the conclusion. The explanation is 
like an argument in favor of the conclu¬ 
sion, and of course the user may or may 
not agree with the argument. 

The argument can be used effectively 
for debugging the knowledge base of rules 
and facts. For example, the explanation 
facility presents a better user interface for 
a doctor using an expert system for the 
diagnosis of a disease. Because the expert 
system explains its conclusions, the doctor 
remains in control and can accept or over¬ 
rule the machine. The explanation of 
APES and why of Micro-Prolog are ex¬ 
amples of such facilities. 


In some sense, explanation is like the 
execution trace of the program computing 
a result, but it is quite useful if the number 
of rules and facts applied is relatively 
small. APES displays an edited form of 
execution trace showing how rules and 
facts were used. 

Tracing and debugging. The Prolog-10 
family provides a trace package based on 
the Box model, which views the execution 
of a Prolog program as a sequence of eall, 
exit, fail, and redo events. Prolog program 
execution starts when the user types in a 
query. The Prolog interpreter selects a 
rule, which can answer the query or break 
the query into simpler queries. 

The selection and invocation of a rule is 
called a call. If the query is answered, the 
invoked rule exits successfully. Otherwise, 
the invoked rule fails to satisfy the query 
and other applicable rules are tried (redo 
the query). The user can place watchdog 
points at the four events (call, exit, fail, 
and redo) to trace the execution. 

Editor and filing system etc. Poplog 
provides a screen-oriented editor with 
limited windowing facilities. The editor is 
integrated with the debugger. Either can be 
accessed from inside the other. 

The editor also has a documentation 
facility for user programs. The documen¬ 
tation is stored at three levels: Help, 
Teach, and Reference. An associated pro¬ 
gram library can be automatically linked 
to the user programs. It can also be 
accessed and modified by the user. 

Micro-Prolog provides an English-like 
syntax for entering Prolog faets and rules 
into the system. For example, mother 
( mary, sue ) can be paraphrased as Mary is 
the mother of Sue. 

Many versions of Prolog provide 
metavariables. A metalevel Prolog pro¬ 
gram is capable of processing other Prolog 
programs. This facility makes it easier for 
the user to write his or her own devel¬ 
opment tools in Prolog itself. Small tools 
such as pretty printers and experimental 
Prolog interpreters with various chain¬ 
ing/evaluation strategies can be written in 
Prolog itself. 

The Interlisp 
environment 

Interlisp, or Interactive Lisp, is an in¬ 
tegrated set of tools, or toolbox, for devel¬ 
oping programs in Lisp. Developed about 
ten years ago, it provided one of the most 
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sophisticated forms of development sup¬ 
port at that time. It included uniform error 
handling, automatic error correction, a 
debugger, a filing system, and a screen- 
oriented editor. Lisp was enriched 
with new constructs to access these tools 
through function calls. 

The tools are integrated in two ways: 

(1) All the tools are at the programmer’s 
disposal in almost every state of computa¬ 
tion. For example, the programmer can 
access the editor from inside the debugger 
and then resume debugging. 

(2) A single tool is used for one purpose 
in all states. For example, the automatic 
error-correction module is used in all other 
tools for error correction. 

Now we will describe the individual 
tools. 

Do what I mean (DWIM). The com- 
rnand interpreter ot most tools is intol¬ 
erant of trivial errors by its user. Often a 
small spelling mistake requires the user to 
type in the entire command again. DWIM 
is the automatic error-correction facility 
invoked by the system whenever the inter¬ 
preter detects an error. The DWIM tries to 
guess what the user might have intended 
and fixes the mistake accordingly. It seeks 
the closest match to the misspelled word in 
the collection of words recently used by 
the user. It can take care of spelling 
mistakes in the command languages of the 
editor, the debugger, and the file system. 

DWIM also takes care of many other 
syntactic errors of this kind. Unfortunate¬ 
ly, the corrections are not always right, 
which can cause execution of undesired 
commands. 


Masterscope. During the debugging 
process, the programmer often wants to 
look at definitions of particular functions 
and variables in a program. If the program 
is small, a hardcopy printout or the editor 
window may be adequate, but if it is large 
(say, a 10,0(X)-line program scattered over 
several files and directories, with scores of 
functions and variables), then retrieval of 
particular definitions requires a substan¬ 
tial effort. 

To make this task of retrieval easier. In¬ 
terlisp has a tool called Masterscope, con¬ 
sisting of a database of program-related 
information, a program syntax analyzer 
(parser) to build the database, and a query 
language for the database. Masterscope 
lets the user retrieve the declaration of any 
program object, such as a function, a 
variable, or a type, with little effort. 


Programmer’s Assistant. The interac¬ 
tive environment offers new ways to pro¬ 
vide a more friendly and helpful design en¬ 
vironment to users. A user working on a 
new program often tries an exploratory 
approach to design or debug a module. He 
or she might modify a file and later want to 
revoke the decision if the modifications do 
not yield desirable results. The Program¬ 
mer’s Assistant provides a facility for this 
kind of exploratory programming. It 
maintains a history list of all the com¬ 
mands issued by the programmer with the 
side-effects (changes in functions, direc¬ 
tory, etc.) they caused. The list is used to 
revoke (undo) a previous command, if the 
user so requests. 

Similarly, the Programmer’s Assistant 
lets the user repeat (redo) a sequence of 
past commands. Old commands can be 
composed together and then modified to 
form a new command that saves typing ef¬ 
fort and time. 

File system, editor, and debugger. On 
any modification, the file system loads, 
recompiles, or creates a backup of relevant 
files. It gives the view that the entire pro¬ 
gram resides in a database and that func¬ 
tions, variables, etc. can be accessed con¬ 
veniently through a powerful query 
language. 

The editor can be called by a user com¬ 
mand or from inside an executing func¬ 
tion. Users can add new commands by 
adding their own functions to the editor 
module. The debugger is invoked auto¬ 
matically when the executing user pro¬ 
gram has a major error. The debugger 
enters a read-eval-print loop and lets the 
user execute an arbitrary function as a 
debugging command. The functions can 
look at the back-trace or at the present 
state of variables, change the present state, 
invoke the editor to change a function, 
and resume execution. 

Windows and graphics. The Xerox 1108 
Interlisp-D System uses a large format 
display and a mouse pointing device to 
allow better computer-user interaction. A 
window system lets the user divide the 
workstation screen into several logical 
screens (rectangular areas called 
windows). Each window is like an inde¬ 
pendent screen to view a file or to execute a 
command, and it can display text, graphic 
images, line drawings, or a combination of 
all these. A mouse is used to select one win¬ 
dow out of the existing windows to work in. 


Life-cycle support for 
AI programming 

Because of the increasing use of expert 
systems in commercial applications, they 
should be reliable and robust. Software 
engineering has provided concepts for de¬ 
veloping reliable programs in conven¬ 
tional applications. It divides the life of a 
program into phases: requirement analy¬ 
sis, specification, design and implementa¬ 
tion, usage and maintenance. The division 
of the software life-cycle into various 
phases reduces the complexity of design by 
grouping and ordering the main tasks of 
program development. 

Requirement analysis is aimed at getting 
a complete, consistent, and unambiguous 
idea of the needs of the user, which can 
also serve as a common ground for agree¬ 
ment between the customer and the devel¬ 
oper. The results help chalk out the specifi¬ 
cation of the software system, against 
which the software product can be devel¬ 
oped and tested. 

The implementation, testing, and de¬ 
bugging phases need no elaboration. 

The maintenance phase consists of soft¬ 
ware updates as well as repair of newly 
discovered bugs. 

Requirements engineering. AI program 
development should begin with writing 
complete, consistent, and unambiguous 
requirements of the system. The main ad¬ 
vantages of writing requirements follow: 

(1) It helps in early detection of errors. 
Studies have shown that 30 percent of 
errors are due to faulty specification of re¬ 
quirements and are 10 to 100 times more 
expensive to fix at the implementation 
stage than at the requirements stage. 

(2) It helps in the detection of misunder¬ 
standing between the customer, the devel¬ 
oper, and the user. 

(3) If requirements are written formally, 
then expert system programmers can 
check that all the requirements of the sys¬ 
tem are met. This would be difficult to do 
otherwise. 

(4) It helps in generating good test cases 
and judging the quality of the test cases ac¬ 
tually used. 

Design concepts. Design of the system 
should use software engineering principles 
such as information hiding, separation of 
concerns, layering, and modularity. The 
principle of information hiding can guide 
us in designing rules. It suggests that rules 
and their group should be designed such 
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that they hide some internal details about 
the system. For example, if a queue is used 
in the system, then its priority mechanism 
should be hidden from rest of the system. 

While designing rules, care must be 
taken that different functionalities are 
separated and different rules implement 
these functionalities. For example, rules 
governing pressure and temperature in a 
control system should differ from rules 
governing security of the system. This is 
the principle of separation of concerns. 

The principle of layering suggests that 
the system should be designed as a compo¬ 
sition of layers. Any layer is aware only of 
the layers underneath it. Thus, activation 
of rules at a higher level due to activation 
of rules at a lower level should be minimal. 
Such a design simplifies not only imple¬ 
mentation but also testing. 

The principle of modularity suggests 
that rules that access common informa¬ 
tion and implement related functionality 
should be clustered into one module for 
easy implementation and maintenance. 

Testing by prototyping. Testing of AI 
systems is different from that of conven¬ 
tional systems. Firstly, AI systems often 
show nondeterministic behavior because 
the conflict resolution strategy can depend 
on execution-time parameters. This makes 
the behavior unrepeatable and therefore 
more difficult to debug. 

Secondly, there is no precise input- 
output relationship for rules as there are 
for procedures in conventional software. 
This makes it difficult to use input-output 
analysis for testing. 

Thirdly, the number of ways rules can 
be activated is too large to use branch- and 
path-coverage tools. 

Prototyping is the only ef fe ctive way t^ 
test an AI progr^ . User "experience with 
the prototypecM reveal vital problems in 
the design. However, prototyping of a 
large system can take substantial effort 
and time. 

Maintenance. Maintenance and modifi¬ 
cation is an important part of expert sys¬ 
tems development. Rules evolve with the 
experience of their use and are therefore 
modified more often than algorithms. In 
the case of inexact reasoning, the belief 
support of rules varies with the feedback 
from previous support numbers. Rules 
can also be time-dependent, hence their 
validity can change over time. 

Unfortunately, not much attention has 
been paid to maintenance in expert system 
programming, although many useful tools 
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for maintenance of conventional pro¬ 
grams can be adapted for expert system 
programming. These tools include version 
management systems, configuration man¬ 
agement systems, and modification re¬ 
quest systems. A version management sys¬ 
tem is responsible for storage and easy 
retrieval of various versions of a program. 

A configuration management system is 
responsible for keeping the information 
about various modules of a program and 
generation of the program from these 
modules. A modification request system 
helps in estimating the impact of a change 
in the program. 

Besides the use of these tools, it is also 
necessary that the program be designed 
keeping maintenance in mind. This in¬ 
volves proper documentation of aU design 
decisions and constraints that affected 
these decisions. 

TraceabUity. Traceability refers to the 
ability to locate in a database (of program- 
related information) objects of current in¬ 
terest. For example, if the user changes a 
particular requirement, traceability en¬ 
ables him or her to obtain all related speci¬ 
fication and code modules that need 
modification. 

Traceability can be as useful for large 
expert systems as it is for conventional 
software. For example, if the user changes 
a particular rule, traceability lets him or 
her retrieve all related rules that may con¬ 
flict with the new rule. 

Traceability can be provided using data¬ 
base technology: useful relations can be 
defined to link rules with each other, 
useful attributes can be defined to classify 
rules, and then rules can be retrieved using 
attribute or relation qualification. Ex¬ 
amples of relations are can_activate, se¬ 
mantically _ related, and mutually_ex- 
clusive. Examples of attributes are author, 
date, relevant_requirement_section, and 
version. 

Knowledge-based tools 

AI techniques deal with inherently diffi¬ 
cult problems that cannot be solved with¬ 
out human assistance. Programming has 
been one of the tasks requiring a high de¬ 
gree of human intellectual involvement. 
Naturally, there has been a considerable 
effort to apply AI techniques to the pro¬ 
gramming process. People have worked 
on three different approaches to this 
problem: the transformational approach 
to program generation, modeling of the 


programming process, and using AI tech¬ 
niques to improve other tools. 

The transformational approach aims at 
generating software directly from its speci¬ 
fication. This method can be viewed as an 
extension of the work in providing high- 
level language as a substitute for assembly- 
level programming. High-level languages 
provide relatively concise and more under¬ 
standable notation for programs. They 
also delegate many lower-level decisions 
(such as register allocation and type check¬ 
ing) and implementation details (such as 
storage allocation and recursion) to a com¬ 
piler and allow programmers to concen¬ 
trate on the design process. The transfor¬ 
mational approach can create a high-level 
specification language to relieve pro¬ 
grammers of intermediate level decisions 
(such as data-structure selection and 
coding well-known algorithms) for vari¬ 
ous optimizations. 

KBEmacs, a knowledge-based editor, il¬ 
lustrates some of the concepts described 
above. KBEmacs provides cliches and 
plans for creating Lisp or Ada programs 
with few commands. A cliche is a generic 
parameterized procedure for performing a 
certain task (such as searching). The user 
can invoke a cliche and fill in parameters 
to use it as a part of the program. A good 
set of cliches can provide a vocabulary of 
relevant intermediate and high-level con¬ 
cepts for effective reasoning and commu¬ 
nication. A plan provides convenient 
structures to represent the entire program 
for various manipulations by other tools. 

We can separate the knowledge about a 
program into two parts: software engi¬ 
neering knowledge and application- 
specific domain knowledge. The software 
engineering knowledge is related to experi¬ 
ence in software development (such as life- 
cycle models). 

There are several efforts to develop a 
theory of software engineering kndwl- 
edge—how expert programmers under¬ 
stand, design, implement, test, verify, 
modify, and document programs. 

This research can be used to automate 
some aspects of the program development 
process. The application-specific domain 
knowledge is particular to the problem. 
For example, the laws of mechanics and 
gravitation will be a part of the domain 
knowledge of a program guiding the space 
shuttle. This domain knowledge can be 
used for automatic checking of various 
programming decisions for conformance 
to the physical laws of the application do¬ 
main. We can also use this knowledge to 
check the feasibility of requirements, and 


for validation and testing of the design for 
correctness. 

Various AI techniques can add new 
power to existing development tools. The 
RADC report described applications of AI 
techniques to acquisition, verification, 
and validation of requirements.^® All too 
often, the user does not know precisely the 
features and capabilities he or she wants 
from the software. When that happens, 
the development of user requirements for 
a future software program resembles the 
knowledge acquisition process. Thus, 
knowledge acquisition tools can be used to 
obtain the requirements from the user. 

Applications of AI techniques to soft¬ 
ware validation include theorem provers 
that can add the power of deduction to the 
database storing the program. Use of rule- 
based paradigms can make the prototyp¬ 
ing of products quick and easy. 

The Japanese Fifth Generation Project 
refers to knowledge-based development 
support as systematization technology .'® 
This project tries to use all three ap¬ 
proaches to using AI for development sup¬ 
port. The project aims to make it possible 
to synthesize programs from user re¬ 
quirements with automatic algorithm 
selection from an algorithm bank. It plans 
to achieve this by developing a theory for 
specification and verification of programs 
for automatic synthesis. Other goals of the 
project include the development of a con¬ 
sultant system for program design, and 
many other tools to maintain, improve, 
and manage programs. It is the most am¬ 
bitious project in this direction to date. 


A I programs are no longer mere ex¬ 
perimental objects for a small 
group of researchers in univer¬ 
sities: They are now being used for com¬ 
mercial purposes. Hence, development 
support tools are more necessary than ever 
to produce reliable programs in a cost- 
effective manner. 

The sheer number of programming 
paradigms presents a difficulty in devel¬ 
oping a standard set of development tools. 
They also challenge the creation of a single 
environment with powerful features of all 
the paradigms. Developments like KEE, 
ART, and LOOPS are a step in this direc¬ 
tion. But there are still several issues un¬ 
resolved in designing an open extendible 
architecture that can incorporate newer 
paradigms and features when needed. Pre¬ 
senting a simple and uniform semantic 
view of such a system to all programmers is 
a difficult design problem. 
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AI programming has seldom concerned 
itself with the reliability and maintainabili¬ 
ty of the software, even though they are 
the most important considerations for 
software to be used for a long time. To 
make the products more reliable and 
maintainable, software engineering tech¬ 
niques must be used during development. 
These software engineering techniques in¬ 
clude formal requirements specification, 
support for maintenance, and enforce¬ 
ment of a software life-cycle development 
methodology. The use of these techniques 
in the context of AI will become increas¬ 
ingly important in the future. 

Using AI techniques can further in¬ 
crease the power of support tools. There 
has been some work in modeling the 
knowledge a programmer uses in under¬ 
standing, designing, implementing, verify¬ 
ing, and maintaining programs. Based on 
this knowledge, an expert system can assist 
the programmer in performing many rou¬ 
tine programming activities. It can also use 
the domain knowledge in checking the fea¬ 
sibility of requirements, validation of re¬ 
quirements, and design decisions, all of 
which can greatly reduce the need for in¬ 
spection by human experts. 

Besides the ways discussed here, ad¬ 
vances in human factors, database design, 
networks, knowledge acquisition support, 
and evidential reasoning support will also 
lead to better software development en¬ 
vironments for AI programs. □ 
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Preliminary Call for Papers 
Third Aerospace Computer Security Conference: 


■^PPlyiiig Technology to Systems 


December 8-11, 1987 
The Sheraton World Hotel 
Orlando, Florida 


Sponsored by 

The American Institute of Aeronautics and Astronautics 
The American Society for Industrial Security 
in cooperation with The IEEE Computer Society 


The Conference 

Operational requirements for civil and military systems 
under development increasingly stress the necessity for in¬ 
formation to be readily accessible to users and operators. 
This produces an apparent conflict with policies and direc¬ 
tives which require total protection of system data from com¬ 
promises of privacy, confidentiality, and integrity. Ac¬ 
complishing both of these sets of requirements requires the 
application of the maturing technology of computer security 
to new systems throughout their development cycle. In ad¬ 
dition, operational approaches to satisfy system re¬ 
quirements and accommodate the implementation of 
engineering technology require intensified research and 
development. 

This conference will explore technology applications in 
two complementary aspects: first, the policy issues and 
operational requirements for both civil and military systems; 
and second, the hardware and software tools and techni¬ 
ques being developed to satisfy system requirements. Special 
emphasis will be placed on specific examples of systems 
applications. 

A three-day technical conference exploring the applica¬ 
tion of computer security technology will be preceded by 
a full day of tutorials dealing with policy matters, technology 
applications, and other areas. Full day introductory and ad¬ 
vanced surveys will be offered as well as advanced courses 
exploring specialized technological areas. 

Areas of Interest Include: 

• IVusted DBMSs and Operating Systems 

• Network Security 

• Space Station Requirements 

• Languages & Verification Tools 

• Policy & Management Issues 

• Advanced Architectures 

• C*I Systems 

• SDI Issues & Requirements 

• Risk/Threat Assessments 

• Data Privacy and Integrity 


Papers, Panel Concepts and Tutorials 

Technical papers, panel concepts, and tutorials which ad¬ 
dress the application of computer security technologies in the 
aerospace environment are solicited. Original research, 
analyses and approaches for defining the computer security 
issues and problems identified in the Conference’s interest 
areas; methodological approaches for analyzing the scope and 
nature of computer security issues; and, potential solutions are 
of particular interest. Unclassified preliminary concepts/pro¬ 
posals should be submitted by February 28, 1987. Copies of 
final abstracts of approximately 1000 words must be mailed 
before May 20, 1987. Material should be sent to: 

Papers and Panel Concepts 
Mr. Stephen Walker, 

Technical Program Chairman 
Trusted Information Systems, Inc. 

P.O. Box 45 

Glenwood, MD 21738 

Ilitorials 

Mr. J. Chris Perry 

Tutorial Chairman 

The Mitre Corporation 

1820 Dolley Madison Blvd. 

McLean, VA 22102 

Classified Sessions 

classified sessions at the secret level are planned. 
Preliminary unclassified abstracts and proposals for such ses¬ 
sions should be sent to the Technical Program Chairman. 

Vendor Exhibit 

A technical exhibit program is planned for interested ven¬ 
dors displaying computer and physical security products. In¬ 
formation regarding participation in this program will be mail¬ 
ed to vendors in early January, 1987. Inquiries at this time 
should be sent to the Conference General Ghairman. 

Addition Information 

For more information or to receive future mailings, 
please contact Dr. Joel Levy, General Ghairman at: 

Aerospace Computer Security Associates 
c/o ORI, Inc. 

1375 Piccard Drive 
Rockville, MD 20850 
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Don’t Miss the Leading Appiications- 
Oriented Forum for Users of Ai Systems 
and Equipment 


AI ’87 emphasizes a widening 
array of applications for 
increasing productivity and 
reducing costs in business 
offices, industrial plants, labo¬ 
ratories and many professions. 


Exhibition Highlights 
Newest Technology 



Nearly 150 display booths of AI 
software and hardware provide 
a unique opportunity 
to evaluate 


potentials and to select 
from among the most current 
and sophisticated systems, 
equipment and technology 
available today. 



3rd Annual Presentation 

Artificial Intelligence and 
Advanced Computer Technology 
Conference/Exhibition 

April 22-24, 1987 

Long Beach Convention Center 
Long Beach, California 


Plan Now to Attend! 

Mail Coupon Today for Details 



AI ’87 Conference Program 
to Feature Commercial, 
Industrial & Government 
Applications 

More than 100 papers will 
be presented in 27 technical 
sessions, highlighting such 
topics as: 

Expert Systems 
AI Workstations 
Manufacturing 
AI Languages 
Aerospace/Defense 
Machine Translation 
Medical/Health Care 
Four Tutorials and a Workshop 
round out this informative, 
applications-oriented program. 


Organized By: 

I ■ 1 Tower Conference 
I |L.IV1 I Management Company 

331 W. Wesley St., Wheaton, IL 60187 
(312) 668-8100 Telex: 350427 


Co-Sponsored By: 

Digital Pesibn 


DM Data ina. 



Society for 
Computer Simulation 


USAi 
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Symbolics Architecture 


This architecture 
enables rapid 
development and 
efficient execution of 
large, ambitious 
applications. An 
unconventional design 
avoids trading off 
safety for speed. 


January 1987 


David A. Moon 
Symbolics, Inc. 


W hat is an architecture? In com¬ 
puter systems, an archite cture 
is a sr)ecificati~ of aiTlTirEr 
face. To be dignified by the name architec- 
r- tme, an interface should be designed for a 
long lifespan and should conn ect system 
co mponents maintained by aif terent or g^- 

mzations. Often an architecture is part of a 
“product definition and defines character¬ 
istics on which purchasers of that product 
rely, but this is not true of everything that 
is called an architecture. An architecture is 
more formal than an internal interface be¬ 
tween closely-related system components, 
and has farther-reaching effects on system 
characteristics and performance. 

A computer system typically contains 
many levels and types of architecture. This 
article discusses ±ree architectiir ftft.de- 
fined in Symbolics comniite rs: 

(1) System architecture—defines how 
the system appears to end users and appli¬ 
cation programmers, including the char¬ 
acteristics of languages, user interface, 
and operating system. 

(2) Instruction architecture—defines 
the instruction set of the machine, the 
types of data that can be manipulated by 
those instructions, and the environment in 
which the instructions operate, for exam¬ 
ple subroutine calling discipline, virtual 
memory management, interrupts and ex¬ 
ception traps, etc. This is an interface be¬ 
tween the compilers and the hardware. 

(3) Processor architecture—defines the 
overall structure of the implementation of 
the instruction architecture. This is an in¬ 
terface between the firmware and the 
hardware, and is also an interface between 
the parts of the processor hardware. 

System architecture 

System architecture defines how the sys¬ 
tem looks to the end user and to the pro¬ 
grammer, including the characteristics of 
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languages, user interface, and operating 
system. System architecture defines the 
product that people actually use; the other 
levels of architecture define the mecha¬ 
nism underneath that implements it. Sys¬ 
tem architecture is implemented by soft¬ 
ware; hardware only sets bounds on what 
is possible. System architecture defines the 
motivation for most of the design choices 
at the other levels of architecture. This sec¬ 
tion is an overview of Symbolics system 
architecture. 

The Sym b olics system presents its elf to 
the^er through a high-resolution bitmap 
display . In addition to text and graphics, 
the display contains presentations of ob¬ 
jects. The user operates on the objects by 
manipulating the presentations with a 
mouse. The display includes a continuous¬ 
ly updated reminder of the mouse com¬ 
mands applicable to the current context. 
Behind the display is a powerful symbol 
processor with specialized hardware and 
software. The system is dedicated to one 
user at a time and shares such resources as 
files, printers, and electronic mail with 
other Symbolics and non-Symbolics com¬ 
puters through both local-area and long¬ 
distance networks of several types. The 
local-area network is integral to system 
operation. 

The system is designed for high- 
productivity software deveiopment both 
in symbolic languages, such as Common 
Lisp* and Prolog, and in nonsymbolic 
languages, such as Ada and Fortra n. It is 
also designed for efficient execution of 
large programs, particularly in symbolic 
languages, and delivery of such programs 
to end users. The system is intended to be 
especially suited to complex, ambitious ap¬ 
plications that go beyond what has been 
done before; thus it provides facilities for 
exploratory programming, complexity 
management, incremental construction of 
programs, and so forth. The operating 
system is written in Lisp and the architec- 
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tural concept originated at the MIT Artifi¬ 
cial Intelligence Laboratory. However, ap¬ 
plications are not limited to Lisp and AI. 
Many non-AI applications that are com¬ 
plex enough to be difficult on an ordi¬ 
nary computer have been successfully 
implemented. 

Meeting these needs requires an extraor¬ 
dinary system architecture—just another 
PC or Unix clone won’t do. The intended 
applications demand a lot of processor 
power, main and virtual memory size, and 
disk capacity. The system must provide as 
much performance as possible without ex¬ 
ceeding practical limits on cost, and com¬ 
puting capacity must not be diluted by 
sharing it among multiple users. These 
purely hardware aspects are not sufficient, 
however. The system must also improve 
both the speed of software production and 
the quality of the resulting software by 
providing a more complete substrate on 
which to erect programs than has been 
customary. Programmers should not be 
handed just a language and an operating 
system and be forced to do everything else 
themselves. 

At a high level, the Symbolics substrate 
provides many facilities that can be incor¬ 
porated into user programs, such as user- 
interface management, embedded lan¬ 
guages, object-oriented programming, 
and networking. At a low level, the sub¬ 
strate provides full run-time checking of 
data types, of array subscript bounds, of 
the number of arguments passed to a func¬ 
tion, and of undefined functions and vari¬ 
ables. Programs can be incrementally 
modified, even while they are running, 
and information needed for debugging is 
not lost by compilation. Thus the edit- 
compile-test program development cycle 
can be repeated very rapidly. Storage man¬ 
agement, including reclamation of space 
occupied by objects that are no longer in 
use, is automatic so that the programmer 
does not have to worry about it; incre¬ 
mental so that it interferes minimally with 
response to the user; and efficient because 
it concentrates on ephemeral objects, 
which are the best candidates for reclama¬ 
tion. The system never compromises safe¬ 
ty for the sake of speed. (A notorious 
exception, the dynamic rather than indef¬ 
inite extent of &rest arguments, is recog¬ 
nized as a holdover from the past that is 
not consistent with the system architecture 
and will certainly be fixed in the future.) 

In an ordinary architecture, such fea¬ 
tures would substantially diminish perfor¬ 
mance, requiring the introduction of 
switches to turn off the features and regain 


speed. Our system architecture deems this 
unacceptable, because complex, ambi¬ 
tious application programs are typically 
never finished to the point where it is safe 
to declare them bug-free and remove run¬ 
time error-checking. We feel it is essential 
for such applications to be robust when 
delivered to end users, so that when some¬ 
thing unanticipated by the programmer 
happens, the application will fail in an ob¬ 
vious, comprehensible, and controlled 
way, father than just supplying the wrong 
answer. To support such applications, a 
system must provide speed and safety at 
the same time. 

Symbolics systems use a combination of 
approaches to break the traditional dilem¬ 
ma in which a programmer must choose 
either speed or safety and comfortable 
software development: 

• The hardware performs low-level 
checking in parallel with computation and 
memory access, so that this checking takes 
no extra time. 

• Machine instructions are generic. For 
example, the Add instruction is capable of 
adding any two numbers regardless of 
their data types. Programs need not know 
ahead of time what type of numbers they 
will be adding, and they need no declara¬ 
tions to achieve efficiency when using only 
the fastest types of numbers. Automatic 
conversion between data types occurs 
when the two operands of Add are not of 
the same type. 

• Function calling is very fast, yet does 
not lose information needed for debug¬ 
ging and does not prevent functions from 
being redefined. 

• Built-in substrate facilities are already 
optimized and available for programmers 
to incorporate into their programs. 

• Application-specific control of 
virtual-memory paging is possible. Pre¬ 
paging, postpurging, multipage transfers, 
and reordering of objects to improve 
locality are supported.^ 

These benefits are not without costs: 

• Both the cost and the complexity of 
system hardware and software are in¬ 
creased by these additional facilities. 

• Performance optimization is not 
always automatic. Programmers still must 
sometimes resort to metering tools. Decla¬ 
rations are available to optimize certain dif¬ 
ficult cases, but their use is much less fre¬ 
quent than in conventional architectures. 

Why Lisp machines? This is really three 
questions: 

(1) Why dedicate a computer to each 
user instead of time-sharing? 


(2) Why use a symbolic system architec¬ 
ture? 

(3) Why build a symbolic system archi¬ 
tecture on unconventional lower-level 
architectures? 

Why dedicate a computer to each user 
instead of timesharing? This seemed like 
a big issue back in 1974 when Lisp 
machines were invented, but perhaps by 
now the battle has been won. A report 
from that era^ states these reasons for 
abandoning time-sharing: 

• Time-sharing systems degrade under 
heavy load, so work on large, ambitious 
programs could only be conducted in off- 
peak hours. In contrast, a single-user sys¬ 
tem would perform consistently at any 
time of day. 

• Performance was limited by the speed 
of the disk when running programs too 
large to fit in main memory. Dedicating a 
disk to each user would give better perfor¬ 
mance. 

The underlying argument was that in¬ 
creasing program size and advancing tech¬ 
nology, making capable processors much 
less expensive, had eliminated the econo¬ 
my of scale of time-sharing systems. The 
original purpose of time-sharing was to 
share expensive hardware that was only 
lightly used by any individual user. The 
serendipitous feature of time-sharing was 
interuser communication. Both of these 
purposes are now served by local-area net¬ 
working. Expensive hardware units are 
still shared, but the processor is no longer 
among them. 

These arguments apply to all types of 
dedicated single-user computers, even 
PCs, not only to symbolic architectures. 

Why use a symbolic system architec¬ 
ture? Many users who need a platform for 
efficient execution of large symbolic 
programs, a high-productivity software 
development environment, or a system for 
exploratory programming and rapid pro¬ 
totyping have found symbolic languages 
such as Lisp and symbolic architectures 
such as this one very beneficial. Programs 
can be built more quickly, and fit more 
smoothly into an integrated environment, 
by incorporating such built-in substrate 
facilities as automatic storage manage¬ 
ment and the flexible display with its 
presentation-based user interface. The full 
error-checking saves time when devel¬ 
oping new programs. The programmer can 
concentrate on the essential aspects of the 
program without fussing about minor 
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mistakes, because the machine will catch 
them. The ability to change the program in¬ 
crementally greatly speeds up development. 

Once the initial exploration phase is 
over, it is possible to turn prototypes into 
products quickly. Good performance can 
be achieved without a lot of programmer 
effort and without sacrificing those devel¬ 
opment-oriented features that are also of 
value later in the program’s life, during 
maintenance and enhancement. 

Why build a symbolic system archi¬ 
tecture on unconventional lower-level ar¬ 
chitectures? Conventional instruction ar¬ 
chitectures are optimized to implement 
system architectures very different from 
Symbolics’. For example, they have no 
notions of parallel error-checking and 
generic instructions; they often obstruct 
the implementation of a fast function call, 
especially one that retains error-checking, 
incremental compilation, and debugging 
information; and they usually pay great 
attention to complex indexing and mem¬ 
ory addressing modes, which have little 
utility for symbolic languages. Implement¬ 
ing Symbolics’ system architecture on a 
conventional instruction architecture 
would force a choice between safety and 
performance: we could not have both. The 
type of software we are interested in either 
could not run at all or would require much 
faster hardware to achieve the same per¬ 
formance. Later^ I will discuss the special 
aspects of Symbolics’ instruction and pro¬ 
cessor architectures that make them more 
suitable to support a symbolic system. 

Comparing the performance of ma¬ 
chines with equivalent cycle times and dif¬ 
ferent architectures can sometimes be il¬ 
luminating. The 3640, VAX 11/780, and 
10-MHz 68020 all have cycle times of 
about 200 ns. (The 68020 takes two clock 
cycles to perform a basic operation, so its 
100-ns nominal cycle time is equivalent to 
the other two machines’ 200 ns.) On a For¬ 
tran benchmark (single-precision Whet¬ 
stone), the VAX is 1.8 times the speed of 
the 3640 (750 versus 400). With floating¬ 
point accelerators on each machine, the 
ratio is 2.1. On the Lisp benchmark 
Boyer, the 3640 is 1.75 times the speed of 
the VAX running Portable Standard Lisp, 
3.9 times the speed of the VAX running 
DEC Common Lisp, and 2.1 times the 
speed of the 68020 running Lucid Com¬ 
mon Lisp. (The 68020 time at 10 MHz was 
estimated by multiplying its 16-MHz time 
by 1.6, no doubt an inaccurate procedure.) 
The VAX and 68020 programs were com¬ 
piled with run-time error checking dis¬ 


abled and safety compromised, while the 
3640 was doing full checking as always; 
Like any benchmark figures presented 
without a complete explanation of what 
was measured, how it was measured, what 
full range of cases was tested, and how it 
can be reproduced in another laboratory, 
these numbers should not be taken very 
seriously. However, they give some idea of 
the effect of optimizing the instruction ar¬ 
chitecture to fit the system architecture. 
One could say that the VAX is three times 
better at Fortran than at Lisp and that the 
68020 and VAX are similar for Lisp. These 
figures also show the effect of different 
compiler strategies on identical hardware. 

This comparison was scaled to remove 
the effect of cycle time and show only the 
effect of architecture. This is not com¬ 
pletely fair to the conventional machines, 
because in general they can be expected to 
have faster cycle times than a symbolic 
machine. Running the 68020 at full speed 
and using a newer model of the VAX 
would have improved their times. Hard¬ 
ware technology of conventional ma¬ 
chines will always be a couple of years 
ahead of symbolic hardware, in cycle time 
and price/cycle, because of the driving 
force of their larger market. It’s interest¬ 
ing to note that this hardware advantage 
applies only to the processor, which usual¬ 
ly contributes less than 25 percent of sys¬ 
tem cost. Power supplies, sheet metal, and 
disk drives don’t care whether the archi¬ 
tecture is symbolic; they cost and perform 
the same for equivalent configurations of 
either type of machine. 

This comparison is not completely fair 
to the symbolic machine, either. Software 
exploiting the full capabilities of the sym¬ 
bolic machine should have been com¬ 
pared, but this software won’t run at all on 
the conventional machines. Software 
technology on symbolic machines will 
always be a couple of years ahead of con¬ 
ventional machines, because it is built on a 
more powerful substrate using more pro¬ 
ductive tools. 

Performance. The best published 
analysis of performance of Lisp systems 
appears in Gabriel’s work."* The various 
3600 models perform quite capably on 
these benchmarks, as can be seen from a 
perusal of the book. Some of the reasons 
for such good performance will become 
apparent as we proceed. 

However, one must always ask exactly 
what a benchmark measures. A problem 
with Gabriel’s benchmarks is that they are 
written in a least common denominator 


dialect that represents Lisp as it was in 
1970. This makes it easier to benchmark a 
broad spectrum of machines, but makes 
the benchmarks less valid predictors of the 
performance of real-world programs. 
Since 1970, there have been many ad¬ 
vances in the understanding of symbolic 
processing and in the range of its applica¬ 
tions. The basic operations measured by 
these benchmarks, such as function call¬ 
ing, small-integer arithmetic, and list pro¬ 
cessing, are still important today, but 
many other operations not measured are 
of equal importance. These benchmarks 
do not use the more modern features of 
Common Lisp (such as structures, se¬ 
quences, and multiple values), do not use 
object-oriented programming, and are 
generally not affected by system-wide 
facilities such as paging and garbage col¬ 
lection. As predefined, portable pro¬ 
grams, these benchmarks cannot benefit 
from the unusual aspects of Symbolics sys¬ 
tem architecture, such as large program 
support, full run-time safety, efficient 
storage management, substrate facilities, 
support for languages other than Lisp, 
and faster development of efficient 
programs. 

Instruction architecture 

Symbolics’ philosophy is that different 
levels of architecture should be free to 
change independently, to satisfy different 
goals and constraints. Users see only the 
system architecture, leaving the lower 
levels, such as the instruction architecture, 
free to change to utilize available technol¬ 
ogy, maximize performance, or minimize 
cost. Most other computer families allow 
users to depend on the instruction archi¬ 
tecture and therefore are not free to change 
it. It tends to be optimized for only the first 
member of the family. Later implementa¬ 
tions using newer technology, as well as 
implementations at the high or low ex¬ 
tremes of the price/performance curve, 
are penalized by the need for compatibility 
with an unsuitable instruction architecture. 

Symbolics system architecture has been 
implemented on three different instruc¬ 
tion architectures. The LM-2 machine, 
based on the original MIT Lisp Machine, ^ 
was the first; it was discontinued in 1983. 
The 3600 family of machines uses a second 
instruction architecture and three dif¬ 
ferent processor architectures. A third 
instruction architecture, appropriate for 
VLSI implementation, is being used in 
a line of future products now under 
development. 
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Figure 3. A string containing the seven characters “Exam¬ 
ple” stores each character in a single 8-bit byte. Bytes are 
packed into 32-bit integer objects. 


Figure 1. An object reference is a 34-bit quantity, consisting 
either of a 32-bit data word with a 2-bit data type tag, or of 
a 28-bit address with a 6-bit data type tag. 
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Figure 4. An ordinary list of two elements requires four 
words of storage. Unlike arrays, lists do not have headers. 


Figure 2. An array of three elements—FOO, 259, and 
BAR—consists of a header word defining the type and 
length of the array, followed by an object reference for each 
array element. 
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Figure 5. A compact list of two elements requires two words 
of storage. It uses the cdr code to eliminate two object 
references. 


(Reprinted from “Architecture of the Symbolics 3600,” 12th Int’l Symp. Computer Architecture, © 1985 IEEE.) 


The following sections summarize the in¬ 
struction and processor architectures of the 
3600 family, discuss some of the design 
tradeoffs involved, and show how these ar¬ 
chitectures are especially effective at sup¬ 
porting the desired system architecture. 
Further details can be found elsewhere. 

Data are object references. The funda¬ 
mental form of data manipulated by any 
Lisp system is an object reference, which 
designates a conceptual object. The values 
of variables, the arguments to functions, 
the results of functions, and the elements 
of lists are all object references. There can 
be more than one reference to a given ob¬ 
ject. Copying an object reference makes a 
new reference to the same object; it does 
not make a copy of the object. 


Variables in Lisp and variables in con¬ 
ventional languages are fundamentally 
different. In Lisp, the value of a variable is 
an object reference, which can refer to an 
object of any type. Variables do not intrin¬ 
sically have types; the type of the object is 
encoded in the object reference. In a con¬ 
ventional language, assigning the value of 
one variable to another copies the object, 
possibly converts its type, and loses its 
identity. 

A typical object reference contains the 
address of the object’s representation in 
storage. There can be several object refer¬ 
ences to a particular object, but it has only 
a single stored representation. Side-effects 
to an object, such as changing the contents 
of one element of an array, are imple¬ 
mented by modifying the stored represen¬ 


tation. All object references address the 
same stored representation, so they all see 
the side-effect. 

In addition to such object references by 
address, it is possible to have an immediate 
object reference, which directly contains 
the entire representation of the object. The' 
advantage is that no memory needs to be 
allocated when creating such an object. 
The disadvantage is that copying an im¬ 
mediate object reference effectively copies 
the object. Thus, immediate object refer¬ 
ences can only be used for object types that 
are not subject to meaningful side-effects, 
have a small representation, and need very 
efficient allocation of new objects. Small 
integers (traditiohally called ffacnums) and 
single-precision floating-point numbers 
are examples of such types. 
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In the 3600 architecture, an object ref¬ 
erence is a 34-bit quantity consisting of a 
32-bit data word and a 2-bit major data 
type tag. The tag determines the interpre¬ 
tation of the data word. Often the data 
word is broken down into a 4-bit minor 
data type tag and a 28-bit address (see 
Figure 1). This variable-length tagging 
scheme accommodates industry-standard 
32-bit fixed and floating-point numbers 
with a minimum of overhead bits for tag¬ 
ging. Addresses are narrower than num¬ 
bers to make additional tag bits available 
for the many types of objects that Lisp 
uses. 

Addresses are 28 bits wide and designate 
36-bit words in a virtual memory with 
256-word pages. The address granularity is 
a word, rather than a byte as in many other 
machines, because the architecture is 
object-oriented and objects are always 
aligned on a word boundary. This results 
in one gigabyte of usable virtual memory. 
It is interesting to note that the 36(X)’s 
28-bit address can actually access the same 
number of usable words as the VAX’s 
32-bit address, because the VAX expends 
two bits on byte addressing and reserves 
three-fourths of the remaining address 
space for the operating system kernel and 
the stack (neither of which is large). 

In addition to immediate and by-ad¬ 
dress object references, the 3600 also uses 
pointers, a special kind of object reference 
that does not designate an object as such. 
A pointer designates a particular location 
within an object or a particular instruction 
within a compiled function. Pointers are 
used primarily for system programming. ^ 

Stored representations of objects. The 
stored representation of an object is con¬ 
tained in some number of consecutive 
words of memory. Each word may contain 
an object reference, a header, a special 
marker, or a forwarding pointer. The data 
type tags distinguish these types of words. 
For example, an array is represented as a 
header word, containing such information 
as the length of the array, followed by one 
memory word for each element of the ar¬ 
ray, containing an object reference to the 
contents of that element (see Figure 2). An 
object reference to the array contains the 
address of the first memory word in the 
stored representation of the array. 

A header is the first word in the stored 
representation of most objects. A header 
marks the boundary between the stored 
representations of two objects. It contains 
descriptive information about the objeet 
that it heads, which can be expressed as 


either immediate data or an address, as in 
an object reference. 

A special marker indicates that the 
memory location containing it does not 
currently contain an object reference. Any 
attempt to read that location signals an er¬ 
ror. The address field of a special marker 
specifies what kind of error should be sig¬ 
nalled. For example, the value cell of an 
uninitialized variable contains a special 
marker that addresses the name of the 
variable. An attempt to use the value of a 
variable that has no value provokes an er¬ 
ror message that includes the variable’s 
name. 

A forwarding pointer specifies that any 
reference to the location containing it 
should be redirected to another memory 
location, just as in postal forwarding. 
These are used for a number of internal 
bookkeeping purposes by the storage 
management software, including the im¬ 
plementation of extensible arrays. 

Some objects include packed data in 
their stored representation. For example, 
character strings store each character in a 
single 8-bit byte (see Figure 3). For unifor¬ 
mity, the stored representation of an ob¬ 
ject containing packed data remains a se¬ 
quence of object references. Each word is 
an immediate object reference to an in¬ 
teger, whose 32 bits are broken down into 
packed fields as required, such as four 
8-bit bytes in the case of a character string. 

A word in memory consists of 36 bits, of 
which I have already explained 34. When a 
memory word contains a header or a 
machine instruction, the remaining two 
bits serve as an extension of the rest of the 
word. When a memory word contains an 
object reference, a special marker, or a 
forwarding pointer, the remaining two bits 
are called the cdr code. The representation 
of conses and lists (Steele, p. 26) ‘ saves 
one word by using the cdr code instead of a 
separate header to delimit the boundaries 
of these small objects. In addition, lists are 
represented compactly by encoding com¬ 
mon values of the cdr in the cdr code in¬ 
stead of using an object reference (see 
Figures 4 and 5). 

Tagging every word in memory pro¬ 
duces these benefits; 

• All data are self-describing and the in¬ 
formation needed for full run-time check¬ 
ing of data types, array subscript bounds, 
and undefined functions and variables is 
always available. 

• Hardware can process the tag in par¬ 
allel with other hardware that processes the 
rest of a word. This makes it possible to op¬ 
timize safety and speed simultaneously. 


• Generic instructions alter their opera¬ 
tion according to the tags of their 
operands. 

• Automatic storage management is 
simple, efficient, and reliable. It can be 
assisted by hardware, since the data struc¬ 
tures it deals with are simple and indepen¬ 
dent of context. The details appear else¬ 
where. 

• Data use less storage due to compact 
representations. Programs use less storage 
due to generic instructions and because tag 
checking is done in hardware, not 
software. 

The cost of tagging is that more main 
memory and disk space are required to 
store numerical Information. Each main 
memory word includes 7 bits for error 
detection and correction, so the 4 tag bits 
add 10 percent. Each 256-word disk sector 
includes about 128 bytes of formatting 
overhead, so the 4 tag bits per word add 11 
percent. We feel that the benefits amply 
justify these costs. 

Instruction set. The 3600 architecture 
includes an instruction set produced by the 
compilers and executed by a combination 
of hardware and firmware. All instruc¬ 
tions are 17 bits long, consisting of a 9-bit 
operation field and an 8-bit argument 
field. Instructions are packed two per 
word, whieh is important for performance 
in two ways: 

(1) Dense code decreases paging over¬ 
head by making programs occupy fewer 
pages and 

(2) simplifies the memory system by 
decreasing the ratio of required instruction 
fetch bandwidth (in words/second) to 
processor speed (in instructions/second). 

Every instruction is contained in a com¬ 
piled function, which consists of some 
fixed overhead, a table of constants, and a 
sequence of instructions (see Figure 6). 
The table of constants contains object 
references to objects used by the instruc¬ 
tions, including locative pointers to defini¬ 
tion cells of functions called by this func¬ 
tion. Indirection through the definition 
cell ensures that if a function is redefined 
its callers are automatically linked to the 
new definition. 

Instructions operate in a stack machine 
model: Many instructions pop their 
operands off the stack and push their 
results onto the stack. In addition to these 
0-address instructions, there are 1-address 
instructions, which can address any loca¬ 
tion in the current stack frame. In this way 
the slots of the current stack frame serve 
the same purpose as registers. The 
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Figure 7. A stack frame consists of the caller’s copy of the 
arguments, five header words, the callee’s copy of the 
arguments, local variables, and temporary storage. The 
frame-pointer (FP) and stack-pointer (SP) registers address 
the current stack frame. 

(Reprinted from “Architecture of the Symbolics 3600 ” 12th Int’l Symp. Computer Architecture, © 1985 IEEE.)_ 


Figure 6. A compiled function consists of four words of 
overhead, a table of constants and external references, and 
a sequence of 17-bit instructions, packed two per word. 


1-address instructions include multi¬ 
operand instructions, which pop all of 
their operands except the last off the stack 
and take their last operand from a location 
in the current stack frame. 

There are several ways an instruction 
can use its argument field. Table 1 lists the 
ways to develop the address of an operand 
in the stack or in memory by adding argu¬ 
ment to a base address. Table 2 lists non¬ 
address uses of argument. Each individual 
opcode only uses argument in a single way; 
there are no addressing modes. The moti¬ 
vation for implementing this particular set 
of arguments is to provide for constants 
(including small integers as a special case), 
all types of Lisp variables (local and 
nonlocal lexical, special, structure slot, in¬ 
stance), branching, and byte fields. Byte 
fields were included because they are 
heavily used in system programming. 

Many instructions are simply Lisp func¬ 
tions directly implemented by hardware 
and firmware, rather than built up from 
other Lisp functions and implemented as 
compiled instructions. These Lisp-func¬ 
tion instructions are known as built-ins. 
They take a fixed number of arguments 
from the stack and from their argument 
field. They return a fixed number of values 
on the stack. Examples of built-ins are eq, 
symbolp, logand (with two arguments), 
car, cons, member, and aref (with two 
arguments).' The criterion for imple¬ 
menting a Lisp function as a built-in in¬ 


struction is that hardware is only used to 
optimize key performance areas. When a 
Lisp function is not critical to system per¬ 
formance, or hardware implementation of 
it cannot achieve a major speedup, it re¬ 
mains in software where it is easier to 
change, to debug, and to optimize. 

Using an instruction set designed for 
Lisp rather than adapting one designed for 
Fortran or for a hand-crafted assembly 
language enhances safety and speed. 3600 
instructions always check for errors and 
exceptions, so programs need not execute 
extra instructions to do that checking. In¬ 
structions operate on tagged data, so extra 
instructions to insert and remove tags are 
not needed. Instructions are generic, so 
declarations are not needed to tell the com¬ 
piler how to select type-specific instruc¬ 
tions and translate between data formats. 
In contrast, Lisp compilers for conven¬ 
tional machines® must generate extra 
shifting or masking instructions to 
manipulate tags, must use multi-instruc¬ 
tion sequences for simple arithmetic 
operations unless there are declarations, 
and are always having to compromise be¬ 
tween safety and speed. 

Unlike many machines, the 3600 does 
not have indexed and indirect addressing 
modes. Instead it has instructions that per¬ 
form structured, object-oriented opera¬ 
tions such as subscripting an array or 
fetching the car of a list. This fits the 
instruction set more closely to the needs of 


Lisp and at the same time simplifies the 
hardware by reducing the number of 
instruction formats to be decoded. 

Function call. Storage whose lifetime is 
known to end when a function returns (or 
is exited abnormally) is allocated in three 
stacks, rather than in the main object 
storage heap, to increase efficiency. The 
control stack contains function-nesting in¬ 
formation, arguments, local variables, 
function return values, and small stack- 
allocated temporary objects. The binding 
stack records dynamically bound vari¬ 
ables. ‘ The data stack contains stack- 
allocated temporary objects. This article 
concentrates on the control stack, which is 
the most critical to performance. 

The protocol for calling a function is to 
push the arguments onto the stack, then 
execute a Call instruction that specifies the 
function to be called, the number of argu¬ 
ments, and what to do with the values 
returned by the function. When the func¬ 
tion returns, the arguments have been 
popped off the stack and the values (if 
wanted) have been pushed on. Note the 
similarity in interface between functions 
and built-in instructions. 

Every time a function is called, a new 
stack frame is built on the control stack. A 
stack frame consists of the caller’s copy of 
the arguments, five header words, the 
callee’s copy of the arguments, local vari¬ 
ables, and temporary storage, including 
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arguments being prepared for calling the 
next function (see Figure 7). The current 
stack frame is delimited by the frame- 
pointer (FP) and stack-pointer (SP) regis¬ 
ters, which are available as base registers in 
instructions that use their argument field 
to address locations in the current stack 
frame. 

A compiled function starts with a se¬ 
quence of one or more instructions known 
as the entry vector. The first instruction in 
the entry vector, the entry instruction, 
describes how many arguments the func¬ 
tion accepts, the layout of the entry vector, 
and the size of the function’s constants 
table (see Figure 6), and tells the Call in¬ 
struction where in the entry vector to 
transfer control. The Call instruction and 
the entry vector cooperate to copy the 
arguments to the top of the stack (creating 
the callee’s copy), convert their arrange¬ 
ment in storage if required, supply default 
values for optional arguments that the 
caller does not pass, handle the &rest and 
Apply features of Common Lisp, and 
signal an error if too many or too few 
arguments were supplied. The details are 
beyond the scope of this article. 

Function return. A function returns by 
executing a Return instruction whose 
operands are the values to be returned. 
The value disposition saved in the frame 
header by Call controls whether Return 
discards the values, returns one value on 
the stack, returns multiple values with a 
count on the stack, or returns all the values 
to the caller’s caller. 

Return removes the current frame from 
the stack and makes the caller’s frame cur¬ 
rent, by restoring the saved FP, SP, and 
PC registers. If the cleanup bits in the 
frame header are nonzero, special action 
must be taken before the frame can be 
removed. Return takes this action, clears 
the bit, and tries again. Cleanup bits are 
used to pop corresponding frames from 
the binding and data stacks, for unwind- 
protect, * for debugging and metering pur¬ 
poses, and for stack buffer housekeeping. 

Motivations of the function call disci¬ 
pline. The motivations for this particular 
function-calling discipline are 

• to implement full Common Lisp 
function calling efficiently, 

• to be fast, so that programmers will 
write clear programs, 

• to retain complete information for the 
Debugger, and 

• to be simple for the compiler. 


Table 1. Ways to develop an operand address. 

Beginning of the current stack frame -I- offset 

End of the current stack frame - offset 

Lexical parent’s environment captured in a closure + offset 

Current function’s constants table -i- offset (possibly with indirection) 

An array used as a DEFSTRUCT structure + subscript 

A flavor instance -i- offset (possibly with mapping-table indirection) 

Address of the current instruction ± offset (for branching) 


Table 2. Nonaddress uses of argument field. 

A byte field any number of bits wide, positioned anywhere within a 32-bit word. This 
specification takes ten bits and hence overflows into two bits of operation. 

An immediate integer between -128 and 127 

An immediate integer between 0 and 255 

Extended operation field, to allow more than 512 instructions 


To implement full Common Lisp func¬ 
tion calling efficiently requires matching 
the arguments supplied by the caller—with 
normal function calling or with Apply— 
o the normal, &optional, and &rest pa- 
ameters of the callee, and generating 
default values for unsupplled optional 
arguments. The entry vector takes care of 
this. Common Lisp’s &key parameters are 
implemented by accepting an &rest pa¬ 
rameter containing the keywords and 
values, then searching that list for each 
&key parameter. Multiple values are pass¬ 
ed back to the caller on the stack, with a 
count. The caller reconciles the number of 
values returned with the number of values 
desired. 

Function calling historically has been a 
major bottleneck in Lisp implementa¬ 
tions, both on stock hardware and on 
specially-designed Lisp machines. It is im¬ 
portant for function calling to be as fast as 
possible. If it is not, efficiency-minded 
programmers will distort their program¬ 
ming styles to avoid function calling, pro¬ 
ducing code that is hard to maintain, and 
will waste a lot of time doing optimization 
by hand that should have been done by the 
Lisp implementation itself. The 3600’s 
function call mechanism attains good 
speed (fewer than 20 clock cycles for a one- 
argument function call and return when 
no exceptions occur) by using a stack buf¬ 
fer to minimize the number of memory 
references required, by optimizing the 
stack frame layout to maximize speed 
rather than to minimize space, by arrang¬ 
ing for the checks for slower exception 


cases to be fast (for example. Return sim¬ 
ply checks whether the cleanup bits are 
nonzero), and by using the entry vector 
mechanism to simplify run-time decision¬ 
making. 

The information that the debugger can 
extract from a stack frame includes the ad¬ 
dress of the previous frame (from the 
saved FP in the header), the function run¬ 
ning in that frame (from the header), the 
current instruction in that function (from 
the PC saved in the next frame), the argu¬ 
ments (from the stack—the header speci¬ 
fies the argument count and arrangement), 
the local variables (from the stack), and 
the names of the arguments and local 
variables (from a table created by the com¬ 
piler and attached to the function). 

The compiler is simple because there is 
only a single calling sequence. Any call can 
call any function, and the argument pat¬ 
terns are matched up at run time. Every¬ 
thing is in the stack and no register-saving 
conventions are required, since there are 
no general-purpose registers. 

The principal costs of this function¬ 
calling discipline are the five-word header 
in each frame and the copying of argu¬ 
ments to the top of the stack. The time to 
create the header is not a problem, because 
it is overlapped with necessary memory ac¬ 
cesses, but the space occupied by the 
header and by the extra copy of the 
arguments is a substantial fraction of the 
typical frame size. This extra space is not a 
major problem because the stack buffer is 
large enough (1024 words) that it rarely 
overflows. 
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Argument copying is necessary because 
Common Lisp functions do not take a 
fixed number of arguments. In a function 
with &optional parameters, some of the 
arguments are supplied by the caller while 
the others are defaulted by the entry vec¬ 
tor. The location in the stack frame of an 
argument must not depend on whether it 
was supplied or defaulted, since this varies 
from one call to the next, but the compiler 
must know the location in order to gener¬ 
ate code to access the argument. The entry 
vector could not put default values in the 
standard location if the arguments were 
not at the top of the stack, because the 
frame header would be in the way. In a 
function with an &rest parameter, the 
caller can supply an arbitrary number of 
arguments. If these arguments were at the 
top of the stack, they would make it im¬ 
possible for the compiler to know the loca¬ 
tions of the local variables, which are 
pushed after the arguments. 

Copying the arguments that are not part 
of an &rest parameter to the top of the 
stack solves both these problems. It gives 
the function complete control over the ar¬ 
rangement of its stack frame and makes 
the stack depth constant. Argument copy¬ 
ing takes extra time, but typically only one 
clock cycle per argument, which is faster 
than the run-time decision-making that 
would otherwise be necessary to access an 
optional argument or a local variable. 

Processor architecture 

Three processor architectures are used 
in three representative models of the 3600 
family: 3640, 3675, and 3620. Since they 
all implement the same instruction archi¬ 
tecture, there are substantial similarities 
among their processor architectures. They 
differ due to implementation in different 
technologies and choices of different 
cost/performance tradeoffs, but this over¬ 
view largely glosses over the differences. 

The main goal of each of these proces¬ 
sor architectures is to implement the in¬ 
struction architecture described earlier 
with the highest performance achievable 
within its particular cost budget. The costs 
are generally higher than most worksta¬ 
tions but lower than most minicomputers. 
For high performance the number of clock 
cycles required to execute an instruction 
must be minimized; the goal is to execute a 
new instruction every cycle. Because the 
system architecture specifies that safety 
and convenience must not be compro¬ 
mised to increase performance, instruc¬ 


tions typically make, many checks for er¬ 
rors and exceptions. Minimizing the cycle 
count demands that these checks be per¬ 
formed in parallel, not each in a separate 
cycle. 

Adequate bandwidth for access to 
operands is also required. In the 3600 in¬ 
struction architecture, a simple instruction 
can read two stack locations and write one 
stack location. One of these is a location in 
the current stack frame specified by an ad¬ 
dress in the instruction, while the other 
two are at the top of the stack. Operands 
are supplied by the stack buffer, a 
IK-word memory that holds up to four 
virtual-memory pages of the stack. The 
stack buffer contains all of the current 
frame plus as many older frames as hap¬ 
pen to fit. When the stack buffer fills up 
(during Call), the oldest page spills into 
normal memory to make room for the new 
frame. When the stack buffer becomes 
empty (during Return), pages move from 
normal memory back into the stack buffer 
until the frame being returned to is entirely 
in the buffer. The maximum size of a stack 
frame is limited to what will fit in the stack 
buffer. A second stack buffer contains an 
auxiliary stack for servicing page faults 
and interrupts without disturbing the pri¬ 
mary buffer. 

Associated with the stack buffer are the 
FP and SP registers, which point to the 
current frame and to the top of the stack, 
and hardware for addressing locations in 
the current stack frame via the argument 
field of an instruction, which calculates a 
read address and a write address every 
clock cycle. The third operand access is 
provided by a duplicate copy of the top 
location in the stack, in a scratchpad 
memory, which can be read and written 
every clock cycle. The SP register is incre¬ 
mented or decremented by instructions 
that push or pop the stack. 

The stack buffer provides the same 
operand bandwidth, two reads and one 
write every clock cycle, as in a typical regis¬ 
ter-oriented architecture. It has the advan¬ 
tage that register saving and restoring 
across subroutine calls is not required, 
since all registers already reside in the 
stack. As in a register-window design, 
overhead occurs only when the stack buf¬ 
fer overflows or underflows and requires a 
block transfer between stack buffer and 
main memory. Another advantage is that 
each instruction contains only one address 
instead of three, making the instructions 
smaller (so that they can be fetched from 
main memory more quickly and processed 
with less hardware) and allowing more 


registers to be addressed. A disadvantage 
of a stack architecture is that it requires 
address-calculation hardware, including a 
10-bit (for a IK-word buffer) adder. Since 
each instruction contains only one address 
instead of three, extra instructions are 
sometimes required to move data to the 
top of the stack so they can be addressed. 

Instructions are processed by a four- 
stage pipeline (see Figure 8) under the con¬ 
trol of horizontal microcode. Microcode is 
used as an engineering technique, not to 
create a general-purpose emulator that 
could implement alternate instruction ar¬ 
chitectures. Knowledge of the instruction 
architecture is built into hardware 
wherever that achieves a substantial per¬ 
formance improvement. 

To achieve full performance, instruc¬ 
tions must be supplied to the processor at 
an adequate rate. Each processor model 
has a different design, with different 
tradeoffs. 

The 3640 uses a four-instruction buffer. 
When the buffer is exhausted, or a branch 
occurs, microcode reads two words from 
memory and refills the instruction buffer. 
This design uses much less hardware than 
the other two, but provides lower perfor¬ 
mance. Refilling the buffer takes five 
clock cycles, so in the worst case the per¬ 
formance penalty is about a factor of two. 
With a typical instruction mix, the ob¬ 
served slowdown is about 35 percent, 
because complex instructions such as 
function calls and memory references 
spend more than one cycle in the execute 
stage. 

The 3675 uses a 2K-instruction cache. 
Program loops that fit in the cache execute 
at full speed, with no instruction fetching 
overhead. An autonomous instruction 
prefetch unit fills the cache with instruc¬ 
tions before they are needed, in parallel 
with execution. At the cost of a substantial 
increase in hardware complexity over the 
3640, this design ensures that the pipeline 
almost never has to wait for an instruction. 

The 3620 uses a six-instruction buffer. 
An autonomous instruction prefetch unit 
fills the buffer in parallel with execution. 
The 3620 instruction stage is a compro¬ 
mise between the other two designs. 
Straight-line code executes at full speed, 
but branches execute at 3640 speed 
because they must refill the buffer. 

The datapath contains several units that 
function in parallel (see Figure 9). Simple 
instructions such as data movement, arith¬ 
metic, logical, and byte-field instructions 
execute in a single clock cycle. For exam¬ 
ple, when executing an Add instruction 
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Figure 8. The instruction 
processing pipeiine, with 
variations for three 3600 
family models. 


Figure 9. 3640 datapath, 
contained in the Execute 
and Write stages of the 
pipeline. Other 3600 family 
models have generally 
similar datapaths. 


the following activities all take place in 
parallel: 

• The stack buffer fetches the two 
operands, one from a calculated address in 
the stack buffer memory and the other 
from the duplicate top-of-stack in the 
scratchpad memory. 

• The fixed-point arithmetic unit com¬ 
putes the 32-bit sum of the operands and 
checks for overflow. This result is only 
used if both operands are fixnums. 

• The optional floating-point ac¬ 
celerator, if present, starts computing the 
sum of the operands and checking for 
floating-point exceptions. This result is 


only used if both operands are single¬ 
floats. 

• The tag processor checks the data 
types of the operands. 

• The stack buffer accepts the result 
from the fixed-point arithmetic unit, ad¬ 
justs the stack pointer, and in the write 
stage stores the result at the new top of the 
stack. 

• The decode stage decodes the next in¬ 
struction and produces the microinstruc¬ 
tion that will control its execution. If the 
type-checking unit or either arithmetic 
unit detects an exception, control is 
diverted to a microcode exception handler. 


When the operands of Add are not both 
fixnums, executing the instruction takes 
more than one machine cycle and more 
than one microinstruction. In the case of 
adding two single-floats, the extra time is 
only required because the floating-point 
arithmetic unit is slower than the fbted- 
point arithmetic unit. In other cases, extra 
time is required to convert the operands to 
a common format, to perform double¬ 
precision floating-point operations, or to 
trap to a Lisp function to add numbers of 
less common types. 

Memory-reference instructions such as 
the car and aref Lisp operations are limited 


January 1987 


51 













































































































mainly by the speed of the memory. Car, 
for example, takes four clock cycles. Com¬ 
plex instructions such as Call, Return, and 
the Common Lisp member function in¬ 
voke microcode subroutines. A wide 
microinstruction word and fast microcode 
branching minimize the number of 
microinstructions that need to be exe¬ 
cuted. Simple and memory-reference in¬ 
structions can be discovered to be eomplex 
at run time because of an exceptional con¬ 
dition such as the data type of the 
operands. 


I have described here an unusual sys¬ 
tem architecture and presented an 
overview of the underlying ar¬ 
chitectures that implement it. When con¬ 
sidering the type of applications that this 
system architecture targets, note how im¬ 
portant to their success it is that we com¬ 
promise neither safety nor speed. With 
this in mind, some of the unconventional 
design choices in these architectures were 
made based on rationales with varied bene¬ 
fits and costs. For example, a close fit be¬ 
tween processor, instruction, and system 
architectures improves performance, but 
allowing users to depend on details of the 
instruction architecture can interfere with 


this. The lack of this close fit dissipates the 
hardware price/performance advantage 
of conventional architectures when mea¬ 
suring system-level performance on soft¬ 
ware suited to symbolic architectures. □ 
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T his article describes a symbolic 
multiprocessing system called 
FAIM-1. * FAIM-1 is a highly con¬ 
current, general-purpose, symbolic accel¬ 
erator for parallel AI symbolic computa¬ 
tion. The paramount goal of the FAIM 
project is to produce an architecture that 
can be scaled to a configuration capable of 
performance improvements of two to 
three orders of magnitude over conven¬ 
tional architectures. In the design of 
FAIM-1, prime consideration was given to 
programmability, performance, extensi¬ 
bility, fault tolerance, and the cost- 
effective use of technology. 

Programmability. Although the 
FAlM-1 machine architecture is uncon¬ 
ventional, the software environment pro¬ 
vides a concurrent programming language 
and an application development system 
that are based on models familiar to mem¬ 
bers of the AI community. This environ¬ 
ment permits immediate evaluation of the 
FAIM-1 architecture when that architec¬ 
ture is used for existing applications, and it 
eases the burden on programmers of fu¬ 
ture applications. 

Performance. Effective use of concur¬ 
rency is the primary mechanism employed 
by the FAlM-1 system to increase signifi¬ 
cantly performance over conventional se¬ 
quential systems. Hardware concurrency 
is exploited in the operation of 
• the individual processing elements, 

• subsystems within the processing 
elements, and 

•Work on the FAIM tFairchild AI Machine) project 
was begun at the Fairchild Research Laboratories and 
has since moved to another research lab within 
Schlumberger. 
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• components within each subsystem. 
Software concurrency is exploited in two 
distinct forms. Spatial concurrency in¬ 
volves a set of independent tasks, each 
working on a partitioned piece of the 
problem. Temporal concurrency involves 
pipelined execution in which stages can be 
viewed as concurrent tasks operating on 
elements of a stream of data at different 
times. 

Extensibility. High priority was given to 
creating a design permitting arbitrary ex¬ 
pansion of the hardware resources. Ex¬ 
pansion in FAIM-1 requires minimal re¬ 
wiring, and no modification to either the 
user software or system software. The 
communication topology is planar, and 
therefore will not become a liability as 
technology advances to permit evolution 
from multiple-chip to single-chip process¬ 
ing elements. Wiring complexity scales 
linearly with processing-element count. 
All hardware module interfaces are self- 
timed ’ to permit individual components 
to evolve independently in performance, 
implementation technology, and function¬ 
ality. Self-timed circuit design is a type of 
circuit design discipline that does not use a 
global clock to guarantee synchroniza¬ 
tion. In this style, each component keeps 
time internally and provides interface 
handshaking signals to coordinate with its 
partner subsystems. The result is an archi¬ 
tecture that is easy to modify and exhibits a 
favorable cost/performance ratio under 
scaling. 

Fault tolerance. Any solution to the 
fault-tolerance problem Inherently con¬ 
tains redundancy. The FAIM-1 contains 
significant redundancy, both in terms of 
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processing elements and in the way these 
elements are interconnected. FAIM-1 is 
designed to be fault tolerant at the process¬ 
ing-element level, but not at the gate or cir¬ 
cuit level. The resource-allocation mecha¬ 
nism permits the reassignment of tasks to 
processors, the message-routing algorithm 
is capable of routing messages around 
failed paths and processors, and the sys¬ 
tem software supports self-diagnosis. 

Technology. The architecture is de¬ 
signed to take advantage of the cost and 
performance of both advanced VLSI cir¬ 
cuit technology and advanced packaging 
technology (immersion-cooled wafer hy¬ 
bridization is an example of the latter) as 
they become available. 

The focus of this article is on the physi¬ 
cal architecture of the FAIM-1 system. 
However, to understand some of the de¬ 
sign decisions, one must examine the sa¬ 
lient aspects of both the software system 
structure and the programming language 
that the physical architecture supports. 
The next section (“Software structure”) 
presents a synopsis of both topics: subse¬ 
quent sections present the hardware 
architecture. 


Software structure 

The architecture of the FAIM-1 serves 
as a high-speed evaluation engine for the 
concurrent programming language OIL 
(Our Intermediate Language), and sup¬ 
ports a style of distributed multiprocessing 
system structure that is embodied in the 
runtime operating system. 

The OIL language and OIL objects. 

OIL is a high-level, concurrent, symbolic- 
programming language. The design of 
OIL was influenced by current AI pro¬ 
gramming practices, in which a number of 
AI programming languages are widely 
used. A distillation of these languages 
leaves three main linguistic styles: object- 
oriented programming, logic program¬ 
ming (primarily Prolog), and procedural 
programming (primarily Lisp). A complex 
AI application may require several (or all) 
of these programming styles. Emulating 
one programming style within another is 
inefficient, so there is a need for a better 
linguistic mechanism, one that efficiently 
incorporates or efficiently supports the es¬ 
sential features of the major styles. OIL 
has been designed to provide concurrent 
versions of each of the three linguistic 
styles. 


An OIL program, is a collection of ob¬ 
jects that communicate by sending mes¬ 
sages. The nature of the communication 
structure explicitly indicates the top level 
of concurrency represented by the pro¬ 
gram. Individual objects may themselves 
be concurrent program fragments. An 
OIL object consists of some local state in¬ 
formation (typically in the form of vari¬ 
ables) and several ports through which 
messages are sent and received in FIFO 
order. A behavior, associated with each 
port, describes what the object does in 
response to a message. The behavior is a 
program that may modify the local state 
and/or send messages to other objects. 
Atomic OIL objects are of two distinct 
types: logical and procedural. Logical 
behaviors are written in a declarative style 
similar to a parallel version of Prolog. ^ 
Procedural behaviors are written impera¬ 
tively in a lexically scoped dialect of Lisp 
that is similar to T. ^ Objects can be nested 
heterogeneously to form other objects that 
permit control to pass between declarative 
and imperative behaviors. 

An OIL object consists of 

• state, which is represented as the col¬ 
lection of variables and data struc¬ 
tures that are considered local to the 
object: 

• ports, that is, the set of entry points 
that may receive messages: 

• entries (an entry is a subset of ports): 
and 

• behaviors, that is, code that may be 
either procedural or logical. 

Objects can be created dynamically or 
statically. Upon creation, the state of an 
object is set to its initialization value. An 
object takes action when a message ar¬ 
rives. To support distributed procedure 
calls and parallel process synchronization, 
subsets of ports may be grouped into en¬ 
tries. Behaviors are associated with entries 
rather than ports. When all of an entry’s 
ports have a message, then the associated 
behavior is said to be fireable. In cases 
where only a single port’s message invokes 
a behavior, that port is also labelled as an 
entry. In cases where an object is defined in 
terms of other objects, the inheritance is 
static. 

An object may consist of an arbitrary 
number of behaviors and ports, and each 
behavior is viewed as a potentially inde¬ 
pendent code fragment. Since the object’s 
state is accessible by any of that object’s 
behaviors, a potential source of nondeter- 
minacy exists. To prevent this situation, 
the behaviors are viewed as a set of mutu¬ 
ally exclusive transactions. When a behav¬ 


ior is started up, all other behaviors are in¬ 
hibited until that behavior terminates. 
Furthermore, a behavior may close ports 
and thereby temporarily inhibit message 
delivery on those ports until they are 
subsequently re-opened. 

The roles of logic and procedural com¬ 
ponents are quite distinct. The logic com¬ 
ponent is used to express in a succinct 
manner nondeterministic pattern-driven 
search, while the procedural component is 
used for sequential algorithm specifica¬ 
tion, manipulating unique objects, and ex¬ 
pressing history-sensitive algorithms. 
Neither component projects its semantics 
on the other. Therefore, procedural ob¬ 
jects do not have multiple versions of their 
environments, and logical objects do not 
have changeable state variables. Commu¬ 
nication between logical and procedural 
objects is based on message streams 
managed by manipulation of continua¬ 
tions in the sending and receiving objects. 
The exact semantic significance of contin¬ 
uations is somewhat different on each 
side, but both use continuations as 
“handles” to obtain subsequent values in 
a stream. A logic component accepts an 
input stream of goals, and produces an 
output stream of solutions. In general, 
there are several logical solutions per goal. 
A procedural component accepts an input 
stream of function calls, and produces an 
output stream of response messages, usu¬ 
ally with one response per input function 
call. 

The binding of variables observes the 
semantics of the object in which the vari¬ 
ables are defined. Thus, a logical variable 
has multiple alternative bindings, in keep¬ 
ing with the nondeterministic semantics of 
logic objects, and a procedural variable 
has values that are changed by direct 
assignment. Moreover, components are 
not allowed to violate the binding policies 
imposed by the variable’s proprietor. 
Bound logic variables are invisible to pro¬ 
cedural accessors: instead, such accesses 
directly return the variable’s value. Un¬ 
bound logic variables are detected as such 
in procedural components, but cannot be 
bound by them. Procedural variables are 
passed by value to logic components when 
used in parameters. Hence, procedural 
variables (as assignable entities) are invisi¬ 
ble in logic components. 

The programmer may also annotate 
OIL code with pragmas, which describe 
some of the expected runtime dynamic be¬ 
havior of the code. These programmer- 
supplied hints are used by the static 
resource allocator to partition code and 
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data onto the physical resources of the ma¬ 
chine. The pragma information gives the 
programmer control over some aspects of 
the allocation strategy. If no pragma infor¬ 
mation is supplied, the program will still 
run, although perhaps not as efficiently. 

Procedural OIL. The procedural com¬ 
ponent of OIL is a parallel modification of 
a lexically scoped dialect of Lisp called T. ^ 
The primary modifications to T facilitate 
the use of concurrency; they include a con¬ 
current reformulation of the basic seman¬ 
tics, and the addition of parallel control 
and data structures, operations on parallel 
data structures, and specifiable evaluation 
strategies that permit a variety of parallel 
evaluation methods. The primitive special 
forms are exactly as defined by T with two 
exceptions. The first exception involves 
Cond, which is the normal T conditional. 
Cond also exists in OIL, but Cond= has 
been added, and is the parallel OIL ver¬ 
sion. Cond= causes the guards to evalu¬ 
ate in parallel, and the first one that evalu¬ 
ates to True is pursued. Semantically, this 
implies that an arbitrary evaluation of 
“True” by the guard forces selection, 
since the notion of what is first is not con¬ 
trollable by the programmer. The second is 
to permit special forms for specifying 
pragmas and type information. These are, 
respectively, the Pragma and Proclaim 
special forms. Pragmas fall into three 
categories; 

• estimates of the probability of taking 
a particular branch in a decision, 

• estimates of the size of dynamic data 
structures, and 

• hints about appropriate allocation 
decisions. 

In all other respects procedural OIL is 
isomorphic to T. 

Logical OIL. Logic behaviors are writ¬ 
ten in a parallel form of Prolog that is syn¬ 
tactically similar to DEC-10 Prolog. The 
same notation is used for clauses, lists, and 
several “evaluable predicates.” In gener¬ 
al, operations such as arithmetic func¬ 
tions, which do not have an inherent se¬ 
quential semantics, are the same in both 
languages. Operations like assert and 
retract are not supported. 

An OIL logical program consists of a set 
of named objects, each of which contains 
any number of clauses. The names of the 
objects serve as names of worlds. The logic 
objects can be nested, giving the effect of 
additional worlds. The programmer may 
indicate a goal as solve (x.W), meaning 
that goal X is to be solved in the context of 


world W. This implies that the rules for 
solving X are defined in world W. An inner 
world inherits all the rules of the outer 
worlds. If the programmer omits the world 
specification, then a default single-world 
model is used. The programmer may also 
indicate private rules that are not inherited 
by inner worlds. Logical objects differ 
from procedural objects in that they can¬ 
not have internal state variables. Program¬ 
mers must use procedural code to describe 
operations that modify an object’s local 
state. Variable bindings invoked under 
unification can affect local state only after 
they are passed back to a procedural 
module, which assigns the value to one of 
the object’s state variables. 

Clauses of logic programs are compiled 
into sets of primitive processes. These 
primitive processes are objects that use 
local state variables to represent a portion 
of the global runtime environment. The 
processes respond to incoming messages 
by changing state and generating messages 
for other processes. The two types of 
primitive processes are AND processes 
and OR processes. AND processes execute 
the bodies of nonunit clauses, and OR 
processes manage execution of procedures 
that are defined by more than one clause. 
In the compiled logic program, there is at 
least one AND process for the right hand 
side of each nonunit clause, and at least 
one OR process for each procedure (set of 
clauses with heads that have the same 
functor and arity). An overall view of the 
computation would show an AND/OR 
process tree, with AND processes creating 
OR descendants to solve each literal in a 
goal statement, and OR processes creating 
AND descendants to solve bodies of 
matching clauses. 

In AND processes, the basic actions, the 
internal states, and the reaction to a partic¬ 
ular message depend on the desired con¬ 
trol model. The programmer may provide 
mode declarations on logical variables; for 
example, the literal p(x?,y!) implies that 
when p is evaluated, it will consume a 
binding for x and produce one for y. The 
parallelism in logical OIL is primarily the 
nondeterministic pattern-directed search 
mechanism that is obtained through OR 
parallelism. “* Limited forms of AND paral¬ 
lelism similar to that proposed by De- 
Groot ^ are also provided in cases where in¬ 
dependent AND processes can be identified 
at compile time or by a simple runtime 
ground check. The use of mode declara¬ 
tions significantly enhances the pro¬ 
grammer’s ability to control the amount 
of AND parallelism that can be exploited. 


Interfacing logical and procedural 
behaviors. The interface between the two 
types of behavior components is essential¬ 
ly a form of procedure call. A logical be¬ 
havior calls a procedural behavior by 
means of an evaluable predicate that is 
syntactically identified. The primary dif¬ 
ference in the semantics is that the solution 
of a logical subgoal by a procedural be¬ 
havior may succeed more than once. In 
this sense procedural behaviors behave 
more like normal subgoal solutions than 
like conventional Prolog built-in predi¬ 
cates. Subsequent calls to the procedural 
component will result in next messages 
that will retrieve the next stream element. 

A procedural behavior may call a logical 
behavior by sending it a solve message 
containing a goal and a world in which 
that goal is to be solved. Calling the con¬ 
tinuation of the logical behavior will 
retrieve the next element in its solution 
stream. 

Resource allocation. OIL programs are 
compiled into object code on a host Lisp 
Machine. The host then downloads the 
object code onto the FAIM-1 for exe¬ 
cution. Critical decisions about where to 
load individual objects are made during a 
phase of compilation called resource 
allocation. The resource allocation pro¬ 
cess involves balancing the use of the par¬ 
allel execution hardware with the cost of 
runtime communication overhead. The 
resource allocation phase permits the writ¬ 
ing of programs, even if the writer lacks a 
detailed understanding of the hardware, 
interconnection structure, or communica¬ 
tions costs. 

In general, there are three basic ap¬ 
proaches to resource allocation: 

• Programmer-defined allocation, 
which can be implemented either as 
part of the programming language or 
by an alternative description, places 
responsibility for making all resource 
allocation decisions on the 
programmer. 

• In dynamic allocation, the overall 
processor utilization must be mea¬ 
sured at runtime by the system. By 
means of this analysis, the workload is 
adjusted during program execution. 

• Static allocation involves analyzing 
the source program and partitioning it 
into a set of allocatable tasks in a way 
that maximizes processing concurren¬ 
cy while minimizing overhead from 
interprocessor communication. 

The complexity of resource allocation 
for large programs makes it unlikely that 


January 1987 


57 





programmer-defined allocation will be a 
viable long-term solution. Dynamic allo¬ 
cation inherently implies significant levels 
of runtime overhead. Hence, the primary 
focus for FAIM-1 is on static methods. 
The OIL programmer can influence the 
static allocator by special annotations (see 
the discussion of pragmas, above), and 
some simple dynamic load balancing can 
be performed when runtime conditions in¬ 
dicate that it is necessary. 

Hardware structure 

The FAIM-1 architecture consists of a 
number of independent processing ele¬ 
ments, called Hectogons, interconnected 
in a hexagonal mesh. The following sec¬ 
tions describe the overall structure of the 
machine and provide insight into some of 
the design decisions made in creating it. 

Communication topology. Many possi¬ 
ble multiprocessor interconnection 
schemes are currently being investigated. 
See, for example, the current research ef¬ 
forts on the Cosmic Cube,® Butterfly,^ 
and DADO. * Desirable topology charac¬ 
teristics include high performance, re¬ 
duced wiring complexity, flexibility, fault 
tolerance, and simplicity of implementa¬ 
tion. Furthermore, a goal is that these 
properties remain attractive under scaling. 

The topology used in the FAIM-1 is a 
hexagonal mesh. Processing elements 
communicate directly with six neighbors; 
the processing elements themselves are 
organized into hexagonal surfaces that are 
combined in a similar six-neighbor 
fashion. 

When wires leave a processing surface 
through the processing elements at the 
periphery, they are folded back onto the 
surface in a three-axis variant of a twisted 
torus. In Figure 1, the basic topology is il¬ 
lustrated, along with the wrap lines and 
switches that complete the interconnect 
structure. For purposes of illustration, 
only a single, wrapped axis is shown; in the 
complete topology, all edge ports are con¬ 
nected, requiring two additional sets of 
wraps like the one shown in the diagram. 

This particular wrapping scheme results 
in a simple routing algorithm and provides 
a minimal switching diameter for a hex¬ 
agonal mesh. All PEs are viewed as if they 
were the center PE of the surface, and 
routing decisions are based on three-axis 
relative coordinates. This simple algo¬ 
rithm is implemented in custom hardware 
for performance reasons. 


Each peripheral port communicates 
with an off-surface device, as well as being 
wrapped back to the opposite edge of the 
surface. These off-surface connections 
permit communications with I/O devices 
and with other surfaces. The external con¬ 
nections are made by introducing a simple 
three-way switch, which is shown in Figure 
1. Communication with other processors 
on the surface is via the three-way switch, 
which routes signals back to the other edge 
of the surface. The switches have three 
ports: 

• internal (for local surface messages), 

• external (for adjacent surfaces, I/O 
devices, or the host), and 

• wrap (for the local surface via the 
wrap line). 

Switching decisions are based on which of 
the three ports a message arrives on and 
the destination contained in the message 
header. 

The size of a surface is defined by the 
number of processors n on each edge of 
the hexagonal surface. The surface is re¬ 
ferred to as an E-n surface; the number of 
processors in a surface scales as 3n(n-l) + 

1. For example, an E-3 processor surface 
has three processors on each of the six 
edges and contains a total of 19 processors. 
For surface sizes between E-1 and E- /in¬ 
clusive, the iiumber of PEs is a prime num¬ 
ber, which is advantageous from the stand¬ 
point of fault tolerance and initialization. 

A hierarchical instance of a FAIM-1 
processor is built by tessellating multiple 
hexagonal surfaces. Locality among 
groups of processors is increased and th? 
communication diameter of the system is 
decreased as compared with a single¬ 
surface instance that has the same number 
of processors. These properties can be 
demonstrated by the following example. 
An E-7 surface contains 127 processors 
and has a diameter of six, while seven E-3 
surfaces can be tiled to form an S-2 E-3 
machine (shown in Figure 2) that contains 
133 processors with a diameter of five. The 
switching diameter improves dramatically 
as the processor count is increased. A 
58,381-processor E-140 has a diameter of 
139, while a 58,807-processor S-9 E-10 
FAIM instance results in a diameter of 89, 
a full 50 hops better (worst case) than the 
single E-140 surface. 

The probability of component failure in 
a system statistically increases as more 
components are added to the system,® 
making fault tolerance an important as¬ 
pect of highly replicated architectures. 
Fortuitously, distributed ensemble archi¬ 
tectures intrinsically contain redundant 


elements that can be used to support fault- 
tolerant behavior. Korenhas shown that 
hexagonal meshes are particularly attrac¬ 
tive fault-tolerant topologies. In addition, 
fault-tolerant message routing is possible 
because of the multiplicity of paths over 
which a message may be routed to its 
destination. 

In the FAIM-1 machine, all of the topol¬ 
ogy-dependent hardware is contained in a 
single subsystem called the Post Office, 
which is described in detail in a later sec¬ 
tion. The remainder of the machine is in¬ 
dependent of connection topology, and 
could be utilized in other connection 
schemes. 

The Hectogon. The processors located 
at each node in the communication topol¬ 
ogy are called Hectogons. A Hectogon can 
be viewed as the homogeneously repli¬ 
cated processing element of the FAIM-1 
architecture on one hand, and as a 
medium-grain, highly concurrent, hetero¬ 
geneous, shared-memory multiprocessor 
on the other. Internally, each Hectogon is 
constructed of several subsystems or 
coprocessors, all of which may be active 
concurrently. 

This double view is the result of the con¬ 
sistent exploitation of concurrency at all 
levels of the FAIM-1 system, and is moti¬ 
vated by our belief that the scalability of a 
multiprocessor architecture is of prime im¬ 
portance. Performance of an architecture 
as it is scaled up is critically affected by 
four factors; 

• the performance of each individual 
processor, 

• the average percentage of processors 
that are active, 

• the efficiency of interprocessor com¬ 
munication, and 

• the total number of processors in the 
aggregate machine. 

The intent of the FAIM-1 project is to 
pursue aggressively each of the four as¬ 
pects by designing a powerful processing 
element that permits high levels of 
replication. 

Individual coprocessors directly sup¬ 
port logic programming, parallel Lisp, 
and complex runtime system duties, such 
as task switching and scheduling. Within 
each coprocessor, other linguistic features 
are supported by specific aspects of the ar¬ 
chitecture. For example, the evaluation 
processor contains parallel tag hardware 
to support the polymorphic function¬ 
calling nature of Lisp. Rather than 
allocating a single task to each processing 
element and risking a low percentage of 
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active processors, FAIM-1 allocates a 
number of parallel tasks to each process¬ 
ing element. Tasks can be complex pro¬ 
gram fragments requiring a wide range of 
computational support. This strategy im¬ 
proves processing element utility by in¬ 
creasing the probability that a runnable 
task will exist at any given time. Inter¬ 
process communication is facilitated by 
including a high-performance message¬ 
handling coprocessor (the Post Office). A 
large number of Hectogons can be tiled 
together (as described in the section on 
“Communication topology,” above) to 
form a fully distributed (that is, with no 
shared memory or control) multiprocessor 
system. 

The Hectogon’s subsystems are con¬ 
nected by an asynchronous System Bus 
(SBus), and by custom interfaces in some 
cases. Subsystems communicate with each 
other by means of a flexible, speed- 
independent signalling protocol. The self- 
timed behavior of the subsystems allows 
them to be independently tuned in terms 
of both performance and function with¬ 
out impacting the designs of the other sub¬ 
systems. While each of the six subsystems 
is a reasonably general system-level com¬ 
ponent for distributed ensemble architec¬ 
tures, the particular instantiation of each 
has been tailored with a specific view of the 
Hectogon in mind. A Hectogon’s subsys¬ 
tems and their interconnection are shown 
in Figure 3. 

The six subsystems connected by the 
SBus are 


• Evaluation processor (£P). A stream¬ 
lined, non-microcoded, stack-based 
processor responsible for evaluating 
machine instructions. 

» Switching processor (SP). A small 
context-switching processor that is 
responsible for interpreting the run- 
list in data memory (the Scratch 
RAM) and moving blocked contexts 
out of processor registers and into 
SRAM process-control blocks, and 
then loading a new, runnable context 
into the processor registers. 
Instruction stream memory (ISM). 
A specialized instruction memory that 
not only stores the instructions, but is 
also responsible for finding the ap¬ 
propriate instruction, partially 



Figure 2. S-2 tesseUation of E-3 surfaces. 
(Source: Proceedings of the 1985 Interna¬ 
tional Joint Conference on Artificial In¬ 
telligence, 1985. Used by the courtesy of 
Morgan Kaufman Publishers.) 



Figure 3. Block diagram of a Hectogon. 
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decoding it, and handing it to the EP. 

• Scratch random access memory 
(SRAM). The SRAM is the local- 
data memory of the Hectogon. It is a 
four-ported subsystem that provides 
concurrent access to the EP, SP, 
SBus, and Post Office. 

• Pattern-addressable memory 
(PAM). A parallel associative 
memory system capable of matching 
complex structures, such as 
S-expressions, in which don’t cares 
may exist either in the query or in the 
data. In the present instantiation, the 
match function is “mock unification,” 
that is, the extent to which unification 
can be done without dereferencing 
bound logical variable pointers. 

• Post Office. An autonomous com¬ 
munications subsystem responsible 
for all aspects of the physical delivery 
of inter-Hectogon messages. The Post 
Office is the only topology-dependent 
coprocessor in a Hectogon. 

The remainder of this article presents 
each coprocessor in some detail. 

A two-processor 
partnership 

The processor is designed to be a high¬ 
speed evaluator of OIL programs. As 
such, it contains specific features that pro¬ 
vide efficient support mechanisms for 
object-oriented, procedural, and logic 
programming. Processor utilization on 
the FAIM-1 is improved if a small number 
of independent, and therefore concurrent, 
tasks are allocated onto a single Hectogon. 
This increases the probability that for any 
particular Hectogon, a runnable task will 
be available at any given time. This im¬ 
poses a need for a processor to support 
multitasking and rapid context switches 
between tasks. 

To achieve the goal of rapid context 
switching, the processor is implemented as 
a partnership of two processors; the two 
processors are called the evaluation pro¬ 
cessor (EP) and the switching processor 
(SP). The EP evaluates the currently ac¬ 
tive task, while the SP sets up the next run¬ 
nable task. Tasks run in a context-specific 
register set; the processor contains two 
context-register sets. Each set contains the 
stack buffers, processor status word, gen¬ 
eral-purpose registers, and so on. One set 
is marked active and is used by the EP, 
while the other is marked idle and is used 
by the SP to save the old context and load 
the next context from process-control 


blocks stored in the SRAM. This concur¬ 
rent and cooperative partnership is also 
supported by the SRAM design in that 
both the EP and the SP have separate 
dedicated ports to the SRAM. It typically 
takes a single instruction time to switch 
contexts. This assumes that the SP has 
completed its next-task prefetch activity. If 
this is not the case, then the EP will halt* 
until the new context becomes valid. 

Normally there are four ways that the 
currently running task can be suspended: 
an interrupt, a trap, task termination, or 
task block. A task block can occur at the 
program’s request, or when an unforeseen 
delay is incurred, for example, when a 
message sent to a remote processor re¬ 
quires a reply before the sending task can 
continue. 

In FAIM-1, the same context sets and 
switching mechanism are used for all four 
cases. There is no special supervisor or 
kernel context. In both task termination 
and task blocking, the next reasonable ac¬ 
tion is to run another task, as nothing 
more can be done on the evaluation of the 
current task. Since traps usually require in¬ 
formation from the current context (for 
example, the arguments to the trapped in¬ 
struction require modification by the ser¬ 
vice routine), trap service routines are run 
in the current context in a manner similar 
to that of a simple function call. Interrupt- 
driven tasks inherently start and terminate 
cleanly, and therefore can also be 
evaluated in the current context. 

The EP. The EP executes instructions 
that it receives from the ISM by making 
use of the active-context register set. To 
reduce the complexity of the EP and 
achieve high performance, a stack-based 
RISC" organization was chosen. The 
need for a long word length does not exist, 
since the address space of the local mem¬ 
ory is small and since the focus of the ar¬ 
chitecture is on symbolic processing rather 
than large-value numeric computation. 
The EP is further simplified by the exis¬ 
tence of the ISM, which selects, formats, 
and delivers the proper instruction to the 
EP. 

The existence of a separate instruction 
delivery subsystem (the ISM) permits a 
simple two-stage pipeline to be employed 
for the EP. The first stage supports in¬ 
struction decode, operand selection, and 
modification. The second stage performs 


•Actually, the EP is not explicitly aware that the SP is 
not ready. The self-timed interface between the EP and 
SP will automatically and transparently inhibit the EP 
from evaluating an invalid context. 


the ALU operation, modifies the result if 
necessary, and stores the result. The ISM 
runs concurrently with the EP and effec¬ 
tively contains another two pipeline stages 
that perform effective-address trans¬ 
lation, instruction fetch, and partial in¬ 
struction decode. 

The EP datapath is 28 bits wide. Eight 
bits are reserved for tags that are processed 
in parallel by separate tag-manipulation 
hardware. The tags are analyzed concur¬ 
rently with the processing of the 20-bit 
data field, and may generate a trap when 
the operand tags are inappropriate for a 
particular operation. 

The EP also contains a full 20-bit wide 
ALU that supports logical operators, 
integer arithmetic, and shifting of 
instructions. 

The EP instructions combine the small 
instruction size of stack-organized proces¬ 
sors and the streamlined style of the RISC 
methodology. This is achieved by trading 
register-based arithmetic and logical 
operations for stack-based operations. In 
addition, the instruction set supports a 
simple load-and-store model, which may 
also be indexed from any of the general- 
purpose index registers. 

The instruction set is tuned so that most 
instructions run in a single cycle. The only 
instructions that consume additional 
cycles explicitly are instructions that 
generate memory references, and interface 
instructions to the other subsystems. 
However, any instruction may trap and 
thus effectively consume additional cycles. 
In this case, the instruction is completed 
whenever the target trap routine returns. 

The result is a simple RISC-processor 
that provides significant support for the 
efficient evaluation of OIL programs and 
that is physically small enough to permit 
the high levels of replication required for a 
cost-effective, high-performance FAIM-1 
PE. 

The SP. The context switcher is a small 
processor that loads values found in a pro¬ 
cess control block stored in the SRAM 
into the idle context-register set and 
unloads them, too; it thus permits context 
switching without stealing cycles from the 
EP. The main data structure that the SP 
manipulates is the run-list. The run-list is 
produced by the scheduler, which is an EP 
task that is run when necessary. The run- 
list is a linked list of process-control blocks 
(PCBs)** in which each PCB contains a 
pointer to the next PCB in the list. 

••The actual implementation is more complex than 
this, but additional detail is omitted here for clarity. 
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In blocking, a process calls a system 
routine that requests that the SP perform a 
context swap and save the process’s state. 
(Depending on why the process is block¬ 
ing, it may be moved to the blocked-list or 
may remain on the run-list.) The SP imme¬ 
diately switches to the other set of context 
registers, and the EP can execute instruc¬ 
tions from the new context. The SP then 
moves the contents of the now idle context 
register set to the appropriate task PCB in 
SRAM, examines the run-list to find the 
next runnable task, moves its context from 
the PCB to the idle context register set, 
and sets the proper context validity flag. 
The SP will halt at this point and remain 
halted until another context switch is 
signalled. 

Arriving message traffic from other 
Hectogons may cause idle processes to be 
rescheduled as runnable tasks. The mes¬ 
sage handler and scheduler support this by 
linking arriving messages with their target 
tasks and moving them to the run-list. The 
scheduler can therefore be invoked by a 
“message-delivered” interrupt from the 
Post Office or host machine. 

The instruction stream 
memoiy 

The instruction stream memory (ISM) is 
one of the specialized “smart memories” 
that are employed in the FAIM-1 process¬ 
ing element, and is designed to deliver in¬ 
structions to the processor at high speed. 
To accomplish this task efficiently, the 
ISM performs several functions that are 
usually performed by the processor in a 
conventional system. These include calcu¬ 
lation of instruction addresses, processing 
of branches and subroutine calls, and han¬ 
dling of traps and interrupts. 

Implementing a separate instruction 
delivery module can have several advan¬ 
tages, as is demonstrated in the Dorado ar¬ 
chitecture. Since only instructions are 
stored in the ISM, it can be optimized for 
its sole function of instruction delivery. 
Conventional solutions place a specialized 
intermediate piece of hardware between 
the processor and main memory, such as 
an instruction cache or translation look¬ 
aside buffer. This implies more compli¬ 
cated control and requires that relatively 
slow off-chip signals be driven twice. The 
ISM organization capitalizes on the co¬ 
placement of both the Instruction memory 
and the instruction-delivery-control logic 
on the same VLSI device. Since on-chip 
bandwidth is usually an order of magni¬ 


tude faster than off-chip bandwidth, a 
significant level of manipulation can be 
performed concurrently with processing 
activity in the EP. In addition, very wide 
bus widths are practical on-chip but im¬ 
practical at chip boundaries, thus increas¬ 
ing the effective on-chip bandwidth. 

In addition to the advantages of more 
efficient access to instructions, the design 
of the EP is simplified. The instruction- 
fetch stage of the pipeline has effectively 
been transferred to the ISM, along with 
the program counter. The resulting shorter 
pipeline in the EP increases the through¬ 
put of the processor and simplifies excep¬ 
tion-handling duties. 

The ISM capitalizes on the fact that in¬ 
structions are not randomly accessed. In 
most programs, code is naturally parti¬ 
tioned into small sequences of linearly 
ordered instructions that terminate in 
branches or subroutine calls. These se¬ 
quences are formalized in the FAIM-1 
machine and are called tracks. As one in¬ 
tuits, instruction tracks vary in length; 
however, the ISM’s instruction storage 
maps them onto a set of fixed-length phys¬ 
ical tracks. Linkage information corre¬ 
sponding to control instructions is associ¬ 
ated with the physical tracks in a header 
field. 

Control point information is main¬ 
tained in a current track-address register 
( CTR), which is similar in function to the 
program counter of a conventional sys¬ 
tem. An individual instruction address 
consists of a track number and a track 
offset. 

Branch processing. Execution of 
branch-type instructions is quite complex 
in most large machines, owing to the large 
number of instructions that can cause a 
branch and the wide variety of addressing 
modes allowed. In keeping with the 
streamlined RISC theme, the FAIM-1 uses 
only one jump format, which is flexible 
enough to support conditional and uncon¬ 
ditional branches, calls, and returns. 
Branch-addressing modes that require 
multiple accesses to memory (for example, 
indirect addressing) or branches requiring 
additional arithmetic operations (for ex¬ 
ample, indexed or decrement-and-skip-if- 
zero) are not implemented. Instruction 
decoding becomes simple both for the EP 
and ISM. The ISM examines each instruc¬ 
tion as the instruction is prepared for 
delivery to the EP. When a jump is 
detected, the ISM autonomously and con¬ 
currently processes that instruction, con¬ 
tinuing delivery with the first instruction 


from the target stream. 

Conditional branches are a canonical 
problem, and delay the delivery of source 
code in pipelined program execution. 
They are usually the main bottleneck in 
lookahead and prefetch strategies. In con¬ 
ventional systems, the problem is that by 
the time the branch is executed and the 
correct path is resolved, some succeeding 
instructions have already entered the pipe¬ 
line. If the branch is taken, the current 
contents of the pipeline must be discarded, 
incurring a delay while the pipe is filled 
again. The standard method of keeping 
the pipeline full is to use a delayed branch 
instruction, as is done in the MIPS 
architecture." 

In FAIM-1, the ISM decodes jump in¬ 
structions before they even enter the pipe¬ 
line, so a pipeline flush is not necessary 
and the delayed branch strategy is not ap¬ 
plicable. This is because the required con¬ 
tinuation of the instruction stream is 
always correctly delivered. There is, 
however, an analogous dependence prob¬ 
lem in that the outcome of a conditional 
jump may depend on the result of a previ¬ 
ous instruction that has not yet finished 
executing. To ensure that the branch con¬ 
dition has become valid by the time the 
ISM detects the jump, an advance condi¬ 
tion code set method is used. 

Subroutine calls and returns. A subrou¬ 
tine, or function call, in the OIL language 
compiles to a simple jump instruction and 
is processed by the ISM in almost exactly 
the same manner as a normal jump. The 
jump instruction format contains a 
“save” bit that is set for a “calling” jump 
and indicates that the current contents of 
the “program counter” (the CTR) should 
be saved in a special register called the 
jump track-address register (JTR) before 
the jump is executed. A return from sub¬ 
routine consists of a Jump instruction spe¬ 
cifying the current contents of the JTR as 
the target address. If the called subroutine 
needs to call other subroutines, then it 
must explicitly save and restore the JTR by 
making use of the control stack. 

Eixception handling. Traps and inter¬ 
rupts are additional factors that cause a 
break in the instruction stream. As such, 
they have an impact on the operation of 
the ISM. Traps correspond to error condi¬ 
tions arising during the course of executing 
an instruction, while interrupts are gener¬ 
ated by some external device and are com¬ 
pletely asynchronous with the program be¬ 
ing run. In both cases, the current code 
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stream must be broken to permit the exe¬ 
cution of the trap or interrupt-service 
routine. This is accomplished in a manner 
similar to that of a subroutine call. 

ISM utUity. In a conventional process¬ 
ing system, there is a large amount of un¬ 
desirable traffic between the processor 
and main memory. Not only useful data, 
but information on where to find the data, 
and even information needed to compute 
this information, must be sent to and from 
memory. 

In FAIM-1, one major class of memory 
references is associated with the access of 
the machine code instruction stream. 
Studies indicate that instruction fetches 
can account for 50 percent of all memory 
references on computers such as a VAX or 
IBM S/370. The single-chip organization 
of the ISM greatly reduces the severity of 
this bottleneck. By reflecting the structure 
of instruction tracks in the structure of the 
memory and providing integrated logic to 
perform in an autonomous manner com¬ 
mon functions, such as branching, pre¬ 
fetching and subroutine calls, the design 
of the processor is simplified and new 
levels of performance are made possible. 

The proposed design is simple enough 
to allow single-chip implementation: mul¬ 
tiple ISM chips can be cascaded to provide 
a maximum-size instruction bank of one 
million instructions. The EP organization 
permits an arbitrary number of banks to 
be used in a single PE; however, the first 
prototype will contain only a single 
maximum-size bank per Hectogon. 


The Scratch RAM 

The SRAM is a four-ported, random- 
access memory that is the local-data mem¬ 
ory system of the Hectogon. An SRAM 
contains 1 Meg of 28-bit data words. Each 
data word is further divided into eight tag 
bits and 20 data bits. The SRAM allows 
access to memory through any of its four 
ports, which may all be active concurrent¬ 
ly. The ports are connected to the SBus, 
the evaluation processor, the switching 
processor, and the Post Office. 

The Post Office 

Operational responsibilities of the Post 
Office. The Post Officeis an auton¬ 
omous coprocessor of messages that is 
capable of delivering messages concur¬ 
rently with program execution in the pro¬ 


cessor. The FAIM-1 Post Office contains 
seven data ports: six to Post Office com¬ 
munication processors in topologically ad¬ 
jacent Hectogons, plus an internal port to 
the SRAM of the local Hectogon. There is 
also a system bus link to control communi¬ 
cation with the EP and other devices in the 
Hectogon. All message-delivery control is 
handled autonomously by the Post Office, 
freeing the local Hectogon to process tasks 
rather than stealing EP cycles to support 
inter-Hectogon message traffic. 

The Post Office is responsible for the 
physical delivery of messages across the 
communication topology. Communica¬ 
tion is initialized by the EP, which gener¬ 
ates a message header for and pointer to 
the variable-length message body and 
places them in the SRAM. The Post Office 
extracts the message from the SRAM and 
delivers it by means of virtual cut- 
through^* over the communication net¬ 
work. The receiving Post Office places the 
message in the destination Hectogon’s 
SRAM and notifies its EP that a new mes¬ 
sage has arrived. Since messages may vary 
in length, the Post Office may break larger 
messages up into a series of fixed-length 
packets that are physically transmitted 
across the topology. These packets are 
delivered to their intended destination 
individually. 

The normal mode of delivery is to route 
a message to its destination by means of a 
hardware routing algorithm. In richly con¬ 
nected topologies, such as the hexagonal 
FAIM-1 topology, it is possible for a 
packet to take multiple paths to a nonlocal 
destination. The routing algorithm cdcu- 
lates the shortest paths and secondary 
paths to the destination. General com¬ 
munication efficiency can be significantly 
enhanced with a routing mechanism 
capable of detecting congestion and of 
routing packets around such congested 
areas in the communications network. All 
routes for packets in the Post Office are 
chosen dynamically at delivery time by 
prioritizing the paths and selecting a path 
according to the state of the buffers and 
the network. This mechanism can also be 
extended to introduce fault tolerance, 
since messages can be routed around non¬ 
functional nodes and ports. 

The capability of dynamically routing 
packets around congestion and failed 
components implies that the order of 
packet arrival may vary from the order in 
which the packets were sent. The capabil¬ 
ity of reordering packets at their final 
destination is essential to ensure both 
deterministic behavior and to permit prop¬ 


er reassembly of multiple packet messages. 
Although this increases the amount of 
work required at the receiving Post Office, 
it reduces congestion and failure-related 
message delays. 

From the EP’s point of view, messages 
are assumed to be delivered error-free. 
This assumption places the burden on the 
Post Office to verify checksums for each 
packet, organize retransmission when an 
error is detected, and synchronize packet- 
copy destruction in a way that ensures that 
at least one correct copy of the packet ex¬ 
ists in some Hectogon. Positive and nega¬ 
tive acknowledgment messages can be au¬ 
tomatically echoed back to the sender 
from the destination Post Office upon 
receipt of a message. To avoid deadlock, 
the Post Office prevents unrestricted in¬ 
cremental resource claiming, thereby en¬ 
suring that each Post Office will not be 
congested indefinitely. 

Post Office components. The Post Of¬ 
fice is constructed from three types of 
basic components— port controllers, buf¬ 
fer controllers, and a buffer pool—as 
shown in Figure 4. 

Most of the functions of the Post Office 
are performed by independent port con¬ 
trollers to enhance concurrency. The 
packet ports transmit data to an adjacent 
Hectogon across the topology, while the 
PE port stores and retrieves data from the 
local SRAM. The buffer pool acts as a 
temporary storage site and queue for mes¬ 
sages that have arrived at the destination 
or require intermediate buffering between 
the source and destination nodes. 

All seven ports share the same internal 
buffer pool. The function of the buffer 
controllers is to arbitrate and control ac¬ 
cess to this limited shared resource. The 
controllers are responsible for freeing 
space in the buffers by matching buffered 
packets with free ports on the path to the 
packets’ respective destinations. The 
dynamic behavior of packet delivery is 
further enhanced by the buffer control¬ 
lers, which access the buffers in a fair but 
unordered fashion. 

Performance. Each of the seven ports 
of a Post Office node can potentially be 
transmitting data simultaneously. A 
pessimistic estimate of 20 MHz cycle time 
per port yields a burst communication 
bandwidth of 2'A gigabits per second per 
processor-Post Office ptiir. An E-3 FAIM 
instance with 19 Hectogons will have a 
total peak communication bandwidth of 
approximately 25 gigabits per second. The 
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speed-independent nature of the commu¬ 
nication links automatically avoids syn¬ 
chronization and timing problems when 
peak demands are greater than buffering 
capacity or are owing to resource conflict. 
Such a high bandwidth is desirable for ex¬ 
perimenting with machine scalability and 
supporting large processor counts. 

In general, it is our belief that direct sup¬ 
port for communications will be required 
in MIMD multiprocessors with many pro¬ 
cessing sites. This requires a significant 
reallocation of the transistor budget to 
achieve the proper balance between pro¬ 
cessing and communication performance. 
The Post Office is an experiment that 
couples a scalable topology and architec¬ 
ture with a communication coprocessor 
that is completely responsible for the phys¬ 
ical delivery of messages. By operating 
concurrently with program execution and 
allowing all ports to transfer data simulta¬ 
neously, the performance of the Post Of¬ 
fice should be sufficient even for large- 
scale networks of processors. 


The PAM 

Pattern matching and logic program¬ 
ming. One of the most common functions 
used in AI programming is pattern match¬ 
ing (that is, matching on the LHS of rules, 
database searches, and so on). We feel that 
special pattern-matching support is neces¬ 
sary to achieve high-performance symbol¬ 
ic processing. As elsewhere in the Hecto- 


gon, this support takes the form of a 
specialized memory component, here 
called the pattern-addressable memory (or 
PAM). The PAM is designed to store and 
match on S-expression structures of sym¬ 
bols and words, in much the same way that 
a traditional content-addressable memory 
(CAM) deals with single words. Like a 
CAM, the PAM does its matching in par¬ 
allel over the whole of its stored contents. 

The logic-programming part of OIL is 
based on Prolog, in which the execution 
mechanism, unification, is a special form 
of pattern matching. The PAM can there¬ 
fore be used as a high-performance sub¬ 
system to support the evaluation of logical 
OIL behaviors. In a wider sense, the de¬ 
clarative semantics of Prolog provides a 
way of indicating data to be pattern 
matched and a means to control the appli¬ 
cation of that pattern matching. 

PAM operation. The PAM consists of a 
number of PAM chips and the PAM con¬ 
troller, the latter providing the interface 
with the rest of the Hectogon. The PAM is 
used to store the heads of logic-program 
clauses as a linear array of symbols. Each 
clause head ends in a pointer to the com¬ 
piled code area for that clause. When a 
logic program is evaluated by the EP, it 
sets up the goal to be solved in the SRAM; 
makes a call to the PAM controller; and 
then blocks, awaiting the results. The 
PAM controller, accessing SRAM over the 
SBus, fetches the goal and enters it into the 
PAM chips. The goal is entered symbol by 


symbol and the match computed for all 
the clause heads stored “on the fly.” The 
PAM contains circuitry to detect the 
absence of any matches as soon as that 
condition occurs. In that case, matching 
stops and control of the process returns to 
the EP. 

Otherwise, the controller puts a list of 
the code pointers from the matching ex¬ 
pressions in the SRAM, and reports to the 
EP that it has completed the task. The EP 
then uses the code Indicated to complete 
the unification with the clause head. If 
successful, it then processes the clause 
body. 

The most obvious function of the PAM 
is, therefore, as a clause-indexing device. 
Pattern matching is, however, more than 
just a useful means of clause selection; it is 
also a significant part of the unification al¬ 
gorithm {unification = pattern matching 
+ the logical variable'^). The matching 
that takes place in the PAM amounts to 
full unification for all those terms not in¬ 
volving variables. Recording and checking 
variable bindings is, however, outside of 
the RAM’s scope. Such “bookkeeping” is 
therefore left to the EP, which acts as a 
unification post-processor. 

The PAM memory chip. Each PAM 
chip consists of a number of blocks, each 
of which in turn consists of storage and 
logic parts. The storage part contains the 
symbol name and special tag and status 
bits used in the matching operation. In the 
current implementation, 10 such words 
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Figure 5. PAM floor plan. 


are stored for every “match” section of 
logic. In effect, this logic is multiplexed 
over the storage so as to achieve a work¬ 
able memory density. 

The logic part consists of comparators 
for the name fields and small finite-state 
machines operating on the tags to perform 
the matching function. Fifty-six of these 
blocks are included on each PAM chip, as 
shown in Figure 5. 

The chip contains 560 words of 16-bit 
symbols. If an average clause head has a 
size of seven PAM words, one chip can 
store 80 such expressions. The PAM chip is 
designed so that the controller can run a 
number of them together and in parallel 
without the need for “glue” logic, In this 
way, the total capacity of the PAM is only 
limited by the number of chips used. Ow¬ 
ing to its parallel operation, the speed of 
the matching function is independent of 
the PAM’s size. 


W e have presented an overview of 
the physical architecture of a 
novel, high-performance, sym¬ 
bolic multiprocessing system known as 
FAIM-1. A small-scale prototype of 


FAlM-1 that consists of a single E-3 sur¬ 
face (19 PEs) is under construction. The 
primary performance mechanism is the ex¬ 
ploitation of concurrency at all levels of 
the system. From the top, the FAIM-1 ap¬ 
pears as a medium-grain, homogeneous 
multiprocessor. The topology scales to 
permit an arbitrary number of processing 
elements to be interconnected. Each pro¬ 
cessing element can be viewed from the 
bottom as a heterogeneous, shared- 
memory multiprocessor containing ser¬ 
vers that are specialized to perform mes¬ 
sage delivery, mock-unification, data 
storage and delivery, instruction storage 
and delivery, instruction evaluation, and 
rapid context switching. 

The architecture takes advantage of ad¬ 
vanced circuit and packaging technology 
as a secondary performance enhancement 
mechanism. The present small-scale pro¬ 
totype is being implemented with custom 
CMOS VLSI circuits (the Post Office, 
PAM, and ISM subsystems) and commer¬ 
cially available components (the processor 
and SRAM). The 19-PE initial prototype 
will be attached to a host Symbolics Lisp 
Machine. The programming environ¬ 
ment, OIL compiler, resource allocator. 


debugging tools, and a complete system 
simulator that can be used for initial appli¬ 
cation development all run on the Host 
machine. All of these characteristics will 
enable the FAIM-1 prototype to serve as a 
symbolic acceleratoi to the host Lisp 
Machine. 

While the architecture represents a 
novel and significant reallocation of the 
conventional transistor budget so as to 
provide high performance and efficient 
evaluation of highly concurrent symbolic 
programs, the programming environment 
departs from conventional AI program 
development systems only minimally so as 
to incorporate concurrent application de¬ 
velopment. This eliminates the need to re¬ 
educate programmers, and it means that 
the architecture can be scaled to provide 
two to three orders of magnitude perfor¬ 
mance improvement over conventional AI 
machines. □ 
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What Price Smalltalk? 


David Ungar, Stanford University 
David Patterson, University of California, Berkeley 


Are reduced 
instruction set 
computers good for 
languages like Lisp 
and Smalltalk? With 
the addition of a few 
simple hardware 
changes and software 
techniques—yes. 
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I n anticipation of the promise of 
tremendous hardware advances, soft¬ 
ware researchers have fashioned ex¬ 
pansive programming environments to 
improve programmer productivity. Even 
with the march of technology, exploratory 
programming environments such as 
Smalltalk-80’’2 require such expensive 
computers that few programmers can af¬ 
ford them. With the hope of Increasing 
that community, a research project at the 
University of California created a reduced 
instruction set computer^ for Smalltalk 
called SOAR, which stands for Smalltalk 
on a RISC.'*'^ Figure 1 shows SOAR, a 
32-bit NMOS microprocessor. 

We are now able to estimate the perfor¬ 
mance implications of the Smalltalk-80 
programming environment. In the next 
section we list the demands that Small¬ 
talk-80 places on traditional computer sys¬ 
tems, then present software and hardware 
ideas that answer those demands. 

We have learned a number of lessons 
from the SOAR microprocessor, including 
the hard lesson that we now call “the ar¬ 
chitect’s trap.” 


The demands of 
Smalltalk-80 

To improve programmer productivity, 
Smalltalk-80 removes four restrictions 
found in conventional programming sys¬ 
tems. First, Smalltalk-80 programmers do 
not have to declare the types of variables at 
compile-time. 

(1) Run-time data typing instead of 
compile-time type declarations. The For¬ 
tran statement “I = J K” denotes in¬ 
teger addition and can be performed with 
a single Add instruction. But Smalltalk-80 
has no type declarations, so J and K may 
hold values of any type, from Booleans to 
B-trees. Thus, every time a Smalltalk-80 

0O18-9l62/87/OIOO4)O67$OI,OO © 1987 



Figure 1. Microphotograph of the SOAR 
microprocessor. Using 4-micron line 
^widths, J oan PendletonTed the !m-* 
plementation of this 32-bit micropro¬ 
cessor.*’’ It is 10.7 mm by 8.0 mm, uses 
35,700 transistors, dissipates about 3W, 
and runs abou t 400 ns ner in^fnirtinn 
These chips were fabricated by MOSIS, 
and have performed better than ex¬ 
pected. Xerox also volunteered to make 
some SOAR chips. Although they run at 
330 ns per instruction, the Xerox chips 
do not correctly perform all tests. We are 
considering a fabrication attempt with 
3-micron line widths to further reduce 
the cycle time. 


□ 


system evaluates “J K” it must first 
check the types and then perform the ap¬ 
propriate operation. 

Measurements of conventional Small¬ 
talk-80 systems show that over 90 percent 
of the operations do the simplest 
possible operation, integer addition.® 
Since a type check takes at least as long as 
an Add instruction, most Smalltalk-80 
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Table 1. Speed of SmaUtalk-80 systems. 

System Maker Host Instruction Execution Speed 

Processor Time in ns Model 


BS UCB 68010 

Tek 4404 Tektronix 68010 

Dorado Xerox Dorado 

SOAR UCB SOAR 


400 (18%) interpreter 11 % 

400(18%) interpreter 25% 

67 (100%) microcode 100% 

400 (18%) compiler 107% 


SOAR compiler 

Image "(Rot) (BS) (Newb2s) 

(Xerox) (dmu) (dmu) (ads, pn h) 

O-Q-a-Q 


SOAR 

runtime system 
(Sys) 

(ads, dmu, pnh) 


SOAR assembler 
(Sas) 

(ads, dmu, pnh) 


f" 

SOAR simulator 
(Daedalus) 
(ads, dmu) 




Figure 2. Steps involved in a SOAR simulation. First, Rot removes the object table 
from the Xerox Smalltalk-80 image. We then use BS to make any modifications 
necessary in the image (to eliminate some becomes). Newb2s produces a Smalltalk 
image for SOAR by converting the BS objects to SOAR format, and Hilfinger’s 
Slapdash compiler translates the bytecoded programs into SOAR instructions. We 
have also coded the Smalltalk primitive operations and storage management software 
in SOAR assembly language. After this is assembled, it is fed to Daedalus, our SOAR 
simulator, along with the Smalltalk image. The initials below each system show its 
author: ads is Dain Samples, phn is Paul Hilfinger, and dmu is David Ungar. 


systems waste a lot of time checking types 
for integer arithmetic. 

(2) Dynamically bound messages in¬ 
stead of statically bound procedures. 
Smalltalk was probably the first system to 
be called object oriented, tm approach to 
programming that associates routines with 
data structures to encourage programmers 
to think of programming as sending 
messages to data objects rather than as 
calling procedures to update shared data. 
Thus, the routine to be invoked depends 
on the type of data, and since the type of 
data can change at run-time, the equiva¬ 
lent of a simple procedure call on most sys¬ 
tems is a comparison and table lookup in 
Smalltalk-80. 

(3) Fast compilation to interpreter in¬ 
stead of optimizing compilation to native 
hardware. A key to improving program¬ 
mer productivity is to reduce the time it 
takes to change a program and then test it. 


To shorten the edit-compile-debug cycle, 
the Smalltalk programmer recompiles a 
routine using a simple and fast compiler 
that produces code for a Smalltalk inter¬ 
preter. The Smalltalk interpreter provides 
the foundation for an excellent debugger, 
which further improves programmer 
productivity. 

Like many other systems, Smalltalk 
supports separate compilation so that the 
programmer only waits for one routine to 
be recompiled rather than the whole sys¬ 
tem. But unlike other systems, Smalltalk 
further shortens this cycle by avoiding the 
conventional linking step: routines are 
linked “on the fly” as needed. To shorten 
program development, Smalltalk sacri¬ 
fices potential compile time optimizations 
and static linking that lead to faster pro¬ 
gram execution. 

(4) Automatic dynamic storage alloca¬ 
tion and reclamation instead of program¬ 


mer-controlled dynamic structures. The 
designers of Smalltalk believed that pro¬ 
grammers should not be encumbered with 
managing dynamically varying data, so 
storage management was left to the sys¬ 
tem. Exploratory programming environ¬ 
ments have the added constraint of avoid¬ 
ing distracting pauses while collecting 
garbage, since a major contributor to 
programmer productivity is a fast and 
predictable interaction with the program¬ 
ming environment.® Smalltalk is even 
more challenging for garbage collection, 
since Smalltalk programs tend to generate 
garbage about 10 times faster than most 
Lisp programs. 

The costs on traditional 
systems 

Given the demands mentioned above, 
the obvious question is, how well does 
Smalltalk-80 run on conventional com¬ 
puter systems? The first step in answering 
this question is determining a fair way to 
measure performance. It is always danger¬ 
ous to rely on architects to supply the tests 
of their creations, and fortunately we were 
not put in that predicament. The creators 
of Smalltalk have a standard set of bench¬ 
marks that all Smalltalk implementors use 
to compare systems. Xerox rates perfor¬ 
mance by taking the mean of 13 macro¬ 
benchmarks, plus the text scanning and 
BitBlt micro-benchmarks. Macro-bench¬ 
marks include compilation, decompila¬ 
tion, searching the Smalltalk program 
hierarchy, and so on. 

Table 1 compares the performance on 
several Smalltalk-80 systems using five of 
those large benchmarks. Both the Tek 
4404 and Berkeley Smalltalk (BS) use soft¬ 
ware interpreters, with BS being the ex¬ 
perimental vehicle that we used to study 
Smalltalk. The Dorado is the machine 
used at Xerox to run Smalltalk. The 
SOAR chip has been placed on a board, 
the board has been placed in a worksta¬ 
tion, and this package is running diagnos¬ 
tic programs, but we have not brought up 
the complete Smalltalk system, so we must 
use simulations to estimate performance 
(see Figure 2). This system was described 
at a recent conference." 

The system generally agreed to be fast 
enough for Smalltalk is the Dorado, a 
$120,{XX) ECL* personal computer that 
supports a single programmer at a time. 
(Think of it as a personal computer for 
’Emitter-coupled logic is an expensive 
technology used in mainframes and super¬ 
computers. 
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people who consider the Mercedes Benz a 

commuter car.) If we compare the Dorado Table 2. Summary of innovations. 


to the Smalltalk interpreters on Motorola 
68010 microprocessor-based systems, we 
see that the Dorado is four to eight times 

ST-80 Demands 

Category 

Name 

% slower 
if omitted 

taster, wmch might be expected since the 

instruction time of the Dorado is about six 

mterpretation 


compiler 

100% 

times faster than the instruction time of 

dynamic messages 


in-line cache 

33% 

the 68010. This is not the case for SOAR, 


Software 

direct pointers 

20% 

which is about the same speed as the Dora- 

automatic storage 


generation scavenging 

12% 

uu even inougn me insiruciions are six 

times slower. SOAR is faster than expected 

slow message sends 


register windows 

46% 

because it uses several innovations in soft¬ 


Architecture 

tagged integers 

26% 

ware and hardware (see Table 2), as ex- 

run-time data types 


two-tone instructions 

16% 

plained in the next two sections. 



Figure 3. Caching the target address in the instruction stream. In this example, the 
print routine is called with an argument that is a string. (The argument is passed in 
r6.) The first time the call instruction is executed, the cail contains the address of a 
lookup routine and the word after the caii contains a pointer to the name “print.” 
The iookup routine follows the pointers to the entry table for strings, and finds the 
entry for “print.” It then overwrites the call instruction with a call to that routine 
and replaces the word after the call with the type of the argument (string). (Reprinted 
from “Architecture of SOAR: Smalltalk on a RISC,” Ilth An. Int’l Symp. Com¬ 
puter Architecture, © IEEE.) 


Reducing costs through 
software innovation 

The first place to look for performance 
improvements is with software: it will be a 
very long time before it is as easy to build 
and debug hardware as it is to write and 
debug the equivalent program. Architects 
should only consider hardware implemen¬ 
tations when there are tremendous gains to 
be had in total system performance, and 
when they are sure that function will never 
change. As we shall see, architects don’t 
always follow this sound advice. 

Interpretation. The Smalltalk-80 system 
is defined by a stack-oriented virtual 
machine based on the Dorado Small¬ 
talk-80 implementation. Each instruc¬ 
tion consists of one to three bytes and gen¬ 
erally corresponds to a token in the source 
program. These instructions are usually 
called bytecodes. Bytecodes have the 
following advantages: 

• The simple correspondence between 
source and object code simplifies the com¬ 
piler and debugger. 

• Smalltalk can be transported to a new 
machine by writing only the virtual 
machine emulator. 

This approach has drawbacks too: 

• Decoding such dense instructions 
takes either substantial hardware or 
substantial time. For example, the instruc¬ 
tion fetch unit consumes 20 percent of the 
Dorado CPU, and decoding a simple 
bytecode takes twice as long as executing it 
in Berkeley Smalltalk. 

• Some of the high-level instructions re¬ 
quire many microcycles to execute. These 
multicycle instructions must be sequenced 
by a dedicated control unit. 

The alternative is simply to compile to 
the native instruction set of the machine, 
hoping to gain performance with the tradi¬ 
tional advantage of compilation over in¬ 


terpretation. We estimate compilation im¬ 
proves the performance of SOAR by 100 
percent. A negative consequence of our 
decision to abandon bytecodes is that it 
forces us to rewrite the Smalltalk-80 
debugger. Lee has designed a debugger for 
SOAR and has built a prototype in Berke¬ 
ley Smalltalk. He has exploited the 
hardware organization of SOAR in the de¬ 
sign of the debugger to add a conditional 
breakpoint facility and increase execution 
speed during debugging. 

SOAR may also have played a role in 
inspiring a compiler project at Xerox by 
Deutsch and Schiffman. This imple¬ 
mentation, called PS, provided the speed 
of compilation but maintained consisten¬ 
cy with the interpreter so that the debug¬ 


ger would not have to be modified. Their 
system runs almost twice as fast as inter¬ 
preters using the same microprocessor. 

Caching call targets in-line. Another 
way to improve Smalltalk performance is 
by decreasing the time taken to find the 
target of a call. Once computed, the 
target’s address can be cached in the in¬ 
struction stream for later use, as suggested 
by Schiffman and Deutsch. Figures 3 
and 4 illustrate this idea. This in-line 
caching exacts a price for its time savings: 
the processor must support nonreentrant 
code. 

Although complicated, in-line caching 
pays handsome rewards. The convention¬ 
al way for Smalltalk systems to save call 
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Figure 4. Caching the target address in the instruction stream. The next time the cali 
is executed, controi goes directiy to the string print routine. A proiog checks that the 
current argument’s type matches the contents of the word foilowing the call instruc¬ 
tion. This word contains the type that the argument had the previous time the call 
was executed. If the types match, control falls through to the string print routine, 
otherwise another table lookup is needed. (Reprinted from “Architecture of SOAR: 
Smalltalk on a RISC,” 11th An. Symp. Computer Architecture, © IEEE.) 


Table 3. Summary of generation scavenging’s performance. 


Berkeley Smalltalk 

SOAR 

execution model 
source of data 
processor 
cycle time 

interpreted 

measurements 

MC68010 

400 ns 

compiled 

simulations 

SOAR 

400 ns 

CPU time overhead 

mean 

worst case 

1.5% 

N.A. 

0.9% 

3.3% 

pause time (scavenge duration) 
mean 

worst case 

160 ms 

330 ms 

19 ms 

28 ms 

peak main memory usage 

200 KB 

200 KB 


targets is a hash table. But the overhead 
for probing into a hash table would slow 
SOAR by 33 percent. The penalty for in¬ 
line caching is a software trap mechanism 
to synchronize process switches and cache 
probes. If we were forced to omit this, we 
could use a table containing the last ad¬ 
dresses with an indirect in-line cache. This 
would slow SOAR down by 7 percent. 
Even with in-line caching, SOAR still 
spends 11 percent of its time in call-target 
cache probes and another 12 percent 
handling misses. Further research into 
computing the call’s target might yield 
even more substantial savings. 


Object-oriented storage management. 

Software is also the architect’s best option 
for managing dynamically varying data 
structures, called objects in Smalltalk-80. 
Smalltalk-80 objects are smaller and more 
volatile than data structures in most other 
exploratory programming environments, 
averaging 14 words in length and living for 
about 500 instructions. Smalltalk-80 sys¬ 
tems face three challenges in managing 
storage for objects: 

• Automatic storage reclamation. On 
average, 12 words of data are freed and 
must be reclaimed per 100 Smalltalk-80 
virtual machine bytecodes executed. 


• Virtual memory. All objects must be 
in the same address space. 

• Object-relative addressing. Although 
offsets into objects are known at compile¬ 
time, base addresses are not. Code must be 
compiled to address fields relative to dy¬ 
namically determined base addresses. 

Automatic storage reclamation. SOAR 
supports generation scavenging'* to 
reclaim storage efficiently without requir¬ 
ing costly indirection or reference count¬ 
ing. This algorithm is based on the obser¬ 
vation that most objects either die young 
or live forever. Thus, objects are placed 
into two generations and only new objects 
are reclaimed. 

Storage reclamation has a strong impact 
on performance; most other algorithms 
would squander 10 percent to 15 percent 
of SOAR’S time on automatic storage re¬ 
clamation instead of generation scaveng¬ 
ing’s 3 percent (see Table 3). Hence, 
without generation scavenging SOAR 
would take 4 percent to 15 percent more 
cycles to run the benchmarks. 

Traditional software and microcode im¬ 
plementations of object-oriented systems 
rely on an object address table (see Figure 
5). Each word of an object contains an in¬ 
dex into this table, and the table entry 
contains the address of each object. The 
indirection through the table primarily 
supports compaction. Generation scaveng¬ 
ing provides compaction for free, permit¬ 
ting SOAR to function without an object 
table (see Figure 6). Without this algo¬ 
rithm, the extra work to follow indirect 
pointers through the object table would 
slow SOAR down by 20 percent. These 
results seem confirmed by a recent Small¬ 
talk-80 interpreter that used generation 
scavenging with direct pointers.'^ 
Although we would expect it to be a factor 
of two slower than PS because it is inter¬ 
preted rather than compiled, this imple¬ 
mentation is close to 90 percent of the 
speed of PS. It may be that direct pointers 
and generation scavenging, not used in PS, 
explain the surprisingly close performance. 

Reducing costs through 
architectural innovation 

The basic theme of the SOAR 2uchitec- 
tural additions is to allow the normal case 
to run fast in hardware and to trap to soft¬ 
ware in the infrequent complicated case. 

Tags trap bad guesses. SOAR follows 
the Smalltalk-80 virtual machine in sup- 
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Figure 5. Indirect addressing. In traditional Smalltalk-80 systems, each pointer is 
really a table index. The table entry contains the target’s reference count and memory 
address. This indirection required previous Smalltalk-80 systems to dedicate base 
registers to frequently accessed objects. The overhead to update these registers slowed 
each procedure call and return. (Reprinted from “Architecture of SOAR: Smalltalk 
on a RISC,” 11th An. Symp. Computer Architecture, © IEEE.) 
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Figure 6. Direct addressing. A SOAR pointer contains the virtual address of the 
target object. This is the fastest way to follow pointers. (Reprinted from “Architec¬ 
ture of SOAR: Smalltalk on a RISC,” 11th An. Symp. Computer Architecture © 
IEEE.) 
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Figure 7. SOAR tagged data types. SOAR supports two data types, 31-bit signed ii 
tegers and 28-bit pointers. Pointers include a generation tag. SOAR words could have 
contained 32 bits of data plus one bit of tag for a total of 33 bits. The scarcity of 
33-bit tape drives, disk drives, and memory boards led us to shorten our words to a 
total of 32 bits including the tag (31 bits of data). (Reprinted from “Architecture of 
SOAR: Smalltalk on a RISC,” 11th An. Symp. Computer Architecture, © IEEE.) 


porting only two data types with tags: in¬ 
tegers and pointers.' But SOAR departs 
from the Smalltalk-80 virtual machine by 
starting arithmetic and comparison opera¬ 
tions immediately and simultaneously 
checking the tags. (Figure 7 shows the 
SOAR tag layout.) Most often both oper¬ 
ands are integers and the correct result is 
available after one cycle. If not, SOAR 
aborts the operation and traps to routines 
that carry out the appropriate computa¬ 
tion for the data types. SOAR is the only 
Smalltalk-80 system that overlaps these 
operations. Without tagging, SOAR 
would run 26 percent slower. 

A tagged architecture that lacks micro¬ 
code must include instructions that manip¬ 
ulate and inspect tags. Because the Small¬ 
talk system already relies on the compiler 
to ensure system integrity, we can allow the 
compiler to mix instructions that manipu¬ 
late tags with instructions constrained by 
tags. 

Each SOAR instruction contains a bit 
that either enables or disables tag check¬ 
ing. The untagged mode turns off all tag 
checking and operates on raw 32-bit data. 
In untagged mode the tag bits are treated 
as data, and the complete instruction set 
can be used to manipulate this data. Un¬ 
tagged instructions also allow programs 
written in conventional languages such as 
C and Pascal to run on SOAR. Instead of 
providing two versions of each instruc¬ 
tion, we could have defined a mode bit in 
the program status word (PSW). This 
would have been expensive, increasing 
execution time by 16 percent. 

Multiple overlapping on-chip register 
windows. We used hardware to improve 
the performance of arithmetic operations, 
and also to improve the performance of 
the frequent calls and returns. SOAR, like 
RISC I, optimizes them by providing a 
large, on-chip register file. The registers 
are divided up into overlapping windows. 
Instead of saving or restoring registers, 
calls or returns merely switch windows 
(Figure 8). 

When we compared Smalltalk to the C 
language subroutines, we found that the 
shorter Smalltalk subroutines pass fewer 
operands and use fewer local variables, 
and so need fewer registers. So each 
SOAR register window has 8 registers in¬ 
stead of 12 for RISC I. Figures 8 and 9 
show the register organization of SOAR. 

In addition to 56 more registers, the inclu¬ 
sion of register windows results in the ad¬ 
dition of a register to select the current 
window, a register to detect overflows by 


recording the last saved window, more 
elaborate register decoders, and trapping 
logic.’ 

Despite the cost of all the added hard¬ 
ware, Smalltalk-80’s predilection for pro¬ 
cedure calls makes the register windows 
very important. The cost of saving and re¬ 
storing a conventional register file would 
slow the machine down by 46 percent, 
even with Load- and Store-multiple in¬ 
structions, which we discuss below. 

Register windows allow many registers 
per procedure without making procedure 
calls and returns expensive. ^ Many RISC 


machines use optimizing compilers to 
cleverly allocate variables to registers and 
thus avoid register windows. While this 
may be the right way to go with conven¬ 
tional programming systems like C and 
Pascal, the extra compile time of register 
allocation may be inappropriate for ex¬ 
ploratory programming environments 
such as Smalltalk. 

Architect’s trap 

After the careful and clean design of the 
first Berkeley RISC projects, SOAR went 
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Figure 8. SOAR’s register windows. Like RISC I, SOAR has many physical sets of 
registers that map to the logical registers seen by each subroutine. (Reprinted from 
“Architecture of SOAR: Smalltalk on a RISC,” Ilth An. Symp. Computer Architec¬ 
ture, © IEEE.) 
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Figure 9. Logical view of the register file. 
The Highs hold incoming parameters 
and local variables. The Lows are for 
outgoing arguments. The Specials in¬ 
clude the PSW and a register that always 
contains zero. The Globals are for 
system software such as trap handlers. 
(Reprinted from “Architecture of 
SOAR: Smalltalk on a RISC,” 11th An. 
Symp. Computer Architecture, © 
IEEE.) 


on to try many architectural ideas. Al¬ 
though fully aware of the dangers, we fell 
into what we now call the “architect’s 
trap” several times: 

• Each idea was a clever idea: 

• each idea made a particular operation 
much faster; 

• each idea increased design and simu¬ 
lation time; and 

• not one idea significantly improved 
overall performance! 


Put another way, the primary impact of 
these clever ideas was to increase the dif¬ 
ficulty of building SOAR and thus 
lengthen the development cycle. 

One example is Load- and Store-mul¬ 
tiple mentioned above. When the number 
of activations on the stack exceeds the on- 
chip register capacity, SOAR traps to a 
software routine that saves the contents of 
a set of registers in memory. Unlike RISC 
II, SOAR has load- and store-multiple in¬ 
structions to speed register saving and 
restoring. These instructions can transfer 
eight registers in nine cycles (one instruc¬ 
tion fetch and eight data accesses). With¬ 
out them, the system would need eight in¬ 
dividual instructions that would consume 
sixteen cycles (eight instruction fetches 
plus eight data accesses). In retrospect, 
these multicycle instructions added some 
complexity to the design, and the benefit 
of a three percent reduction of execution 
time is not worth the costs. 

Another example comes from genera¬ 
tion scavenging, which requires that a list 
be updated whenever a pointer to a new 
object is stored in an old object. While 
designing SOAR, we thought that stores 
would be frequent enough to warrant 
hardware support for this check. Thus, 
SOAR tags each pointer with its genera¬ 
tion of the object that it points to. While 
computing the memory address, the store 


instruction compares the generation tag of 
the data being stored with the generation 
tag of the memory address. For 96 percent 
of the stores, list update is unnecessary and 
the store completes without trapping. 
Once again we rely on tags to confirm the 
normal case and trap in the unusual case. 
Surprisingly, tagged stores are so infre¬ 
quent that hardware support saves only 1 
percent of the total time. This feature does 
not seem worth the effort. 

Alas, we have more than two examples 
of being caught in the architect’s trap. We 
have put these observations to use by 
calculating the performance of some 
variations on SOAR and comparing them 
to some real systems (see Table 4). Our 
predictions of SOAR’s performance are 
based on simulated macro-benchmark 
times and do not include virtual memory, 
operating system, and I/O overhead. 
However, all of the Smalltalk-80 systems 
we know about tend to be limited by the 
raw CPU speed rather than the overhead 
time for virtual memory, the operating sys¬ 
tem, and I/O. For a fair comparison, we 
assume a 400-ns cycle time for SOAR, 
RISC II, and MC68010. 

By comparing the speeds of different 
systems, we can gain some insight into the 
reasons for SOAR’s good performance. 

• If we were to build a second- 
generation SOAR, we would implement 
Pendleton’s reorganization of the pipe¬ 
line, which would shorten SOAR’s cycle 
time by 25 percent. By combining it with 
the winning features from the previous 
table the system would run faster than 
SOAR, even though it lacks a half-dozen 
architectural innovations that SOAR has. 
While the overall measurements confirm 
that reduced instructions sets can run 
Smalltalk-80 efficiently, this calculation 
goes further; it suggests that SOAR is not 
RISCy enough. 

• The software techniques developed 
for SOAR may eventually be used to con¬ 
struct fast, compiled Smalltalk-80 systems 
on general-purpose processors. The RISC 
II row of the table reflects the impact of re¬ 
moving the Smalltalk-specific architectur¬ 
al features of SOAR. The next row, RISC 
II without register windows, is representa¬ 
tive of the commercial reduced-instruc- 
tion-set microprocessors. These machines 
would run Smalltalk-80 twice as slow as 
SOAR. This may not be too high a price to 
pay for a simpler and more general off- 
the-shelf design. 

Falling into architect’s traps will delay 
your project, making it less attractive as 
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other, competing, machines are an¬ 
nounced. For example, the Deutsch- 
Schiffman Smalltalk system PS doubled 
performance when Motorola announced 
their 32-bit follow-on to the 68010, palled 
the 68020. It includes a small on-board in¬ 
struction cache, executes instructions in 
180 ns, and uses about five times as many 
transistors as SOAR. Thus, delays in your 
project inevitably reduce the relative at¬ 
tractiveness of your machine, since it is 
unlikely that every other project will face 
the same delays. 


T able 2 summarized the innovations 
used in SOAR to improve the per¬ 
formance of the exploratory pro¬ 
gramming environment Smalltalk-80. If 
we compare SOAR to the Motorola 
68010, we have more than doubled perfor¬ 
mance while halving the number of tran¬ 
sistors. Its features reduce the perfor¬ 
mance penalty for Smalltalk from a factor 
of 3.6 to a factor of 1.3, increasing the 
chances that programmers will use ex¬ 
ploratory programming environments (see 
Table 5). 

We recommend that anyone faced with 
the task of building a computer for an ex¬ 
ploratory programming environment con¬ 
sider compilation to a reduced instruction 
set with register windows and one-bit tags. 
There are four places to look for further 
performance gains: compiler technology, 
implementation technology,^ optimiza¬ 
tion of the run-time support primitives 
(which consume about two-thirds of 
soar’s time), and better hardware or 
software algorithms to cache call-target 
lookups (which consume 23 percent of 
SOAR’S time). Of these, implementation 
technology— circuit design and VLSI pro¬ 
cessing technology—have the most 
dramatic impact. Since we started this proj¬ 
ect, the standard VLSI technology avail¬ 
able to universities has improved from 
four-micron line widths to three-micron. 
This one change could reduce our cycle 
time from 400 ns to 290 ns, as important a 
contribution as register windows. 

We also warn all architects to watch 
their step. Be sure you evaluate your pro¬ 
posal in terms of benefits to the whole sys¬ 
tem and not just to one part, and 
remember that a software solution is bet¬ 
ter than a hardware solution in every facet 
except speed. The bait of the architect’s 
trap is your own ingenuity, but the trap 
ensnares a whole project, not just the fool 
who springs it. Beware! □ 


Table 4. Trimming the fat from SOAR. 

Assumes 4(X)-ns cycle time for SOAR, RISC II, and 68010. Dorado and MC680I0 
figures are measurements. Same benchmarks as Table 1. 


Configuration Speed 

Important architectural features + rearranged pipeline 103 Wo 

full SOAR lOQo/o 

Dorado 93% 

important architectural features only 81% 

Deutsch-Schiffman 68020 72% 

RISC II 62% 

RISC II without register windows 50% 

full SOAR without software ideas 41 Wo 

Deutsch-Schiffman 68010 36% 

full SOAR without hardware ideas 34% 

Tek 68010 interpreter 24% 

stripped SOAR 22% 


Table 5. Cost of Smalltalk-80 features: the standard approach versus SOAR. 


ST-80 Feature 

Cost 

(% slower) 

Optimization 

Cost 

(% slower) 

interpretation 

100% 

compiler 

0% 

dynamic messages 

56% 

in-line cache 

23% 

automatic storage 

15% 

generation scavenging 

3% 

object table 

20% 

direct pointers 

0% 

run-time data types 

26% 

tagged integers 

0% 

many subroutines 

46% 

register windows 

0% 

total cost of ST-80 
(standard architecture) 

3.6:1 

(SOAR) 

1.3:1 
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Initial Performance of 
the DAD02 Prototype 


A 1023-processor 
prototype named 
DAD02 has 
successfully 
demonstrated 
performance 
improvements for 
several important 
problems and has led 
to a number of 
avenues of future 
research. 


January 1987 


Salvatore J. Stolfo 
Columbia University 


O n December 5, 1985 a 1023-pro- 
cessor parallel machin e named 
DAD02 was successfully demon¬ 
strated at Columbia University. DAD02 is 
the fourth prototype, but the first large- 
scale prototype, of a class of machines 
called DADO. 

DADO was first proposed in 1980 as a 
special-purpose parallel computer at¬ 
tached to a conventional host processor 
and designed to accelerate a particular 
class of artificial intelligence rule-based 
programming paradigms called produc¬ 
tion systems. PSs have been widely used 
for the implementation of knowledge- 
based expert systems. 

Since its introduction, we have learned 
that DADO suits the high-speed execution 
of a large class of problems that we call 
almost decomposable searching problem s, 
of which PSs are but one example. Sweral 
specific examples of this class of problems 
presently run on DAD02; others are cur¬ 
rently under development and nearing 
completion. 

In this article 1 present the initial 
measured performance of the imple¬ 
mented systems on the DAD02 proto¬ 
type. This data is preceded by a general 
overview of the DADO architecture and 
the theoretical speedup achievable for 
almost decomposable searching problems. 


The DADO architecture 

DADO is a medium-grain parallel 
machine in which memory and processing 
are extensively intermingled. A full-scale 
version would comprise a large number 
(on the order of thousands) of processing 
elements, each containing its own pro¬ 
cessor; a reasonably small amount of local 
memory (20K-bytes in the current 
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DAD02 prototype) and a specialized I/O 
circuit for high-speed communication. 
The PEs are interconnected in a complete 
binary tree. 

Within the DADO machine, each PE is 
capable of executing in either of two 
modes under the control of run-time soft¬ 
ware. In the first, called SIMD (for single 
instruction stream, multiple data stream), 
the PE executes Instructions broadcast by 
some ancestor PE within the tree. In the 
second, referred to as MIMD (for multiple 
instruction stream, multiple data stream), 
each PE executes instructions stored in its 
own local RAM, independently of the 
other PEs. A single conventional host pro¬ 
cessor adjacent to the root of the DADO 
tree controls the operation of the entire 
ensemble of PEs. 

When a DADO PE enters the MIMD 
mode, its logical state changes in such a 
way as to effectively disconnect it and its 
descendants from all higher-level PEs in 
the tree. In particular, a PE in the MIMD 
mode does not receive any instructions 
that might be placed on the tree-structured 
communication bus by one of its ances¬ 
tors. Such a PE may, however, broadcast 
instructions to be executed by its own 
descendants, provided all of these descen¬ 
dants are in the SIMD mode. The DADO 
machine can thus be configured such that 
an arbitrary internal node in the tree acts 
as the root of a tree-structured SIMD 
device in which all PEs execute a single in¬ 
struction (on different data) at a given 
point in time. 

This discussion oversimplifies DAD02’s 
true operation. DAD02 provides parallel 
remote procedure invocation in the style 
of SIMD processing. The procedures are 
stored locally within the PEs, operate 
autonomously, and, therefore, may take 
different amounts of time to complete. 
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Figure 1. DAD02 circuit board with 32 processing elements. 


Machine-level instructions are not broad¬ 
cast and executed in lock-step. Rather, ad¬ 
dresses of prestored code are broadcast to 
PEs for local execution. This mode of op¬ 
eration may be regarded as SPMD (for sin¬ 
gle program, multiple data stream) 
execution. 

This flexible architectural design sup¬ 
ports multiple-SIMD execution (MSIMD), 
whereby the machine may be logically di¬ 
vided into distinct partitions, each execut¬ 
ing a distinct task. 

The DAD02 I/O switch, implemented 
in semicustom gate array technology, has 
been designed to support rapid global 
communication. In addition, a specialized 
combinational circuit incorporated within 
the I/O switch allows for the very rapid 
selection of a single select PE from a set of 
candidate PEs in the tree, a process we call 
min-resolving. I will detail the importance 
and utility of these operations later. 

I caution the reader not to confuse 
DADO with DAD02. DADO refers to a 
class of machines sharing certain architec¬ 
tural principles: tree-structured topology 
for fast broadcast of data, fast resolution, 
and a software architecture providing 
SIMD, MIMD, and MSIMD (or SPMD) 
modes of operation. The distinction be¬ 
tween members of this family is granulari¬ 
ty, the storage capacity and processor 
functionality at an individual PE. 

DAD02 refers to a single (expedient) 
hardware realization of the architecture 
(see Figure 1) designed to experiment with 
parallel execution of AI PS programs. The 


suffix 2 in DAD02 refers not to the second 
invented architecture, but the second 
hardware realization (or PE design) suc¬ 
ceeding the 15-processor DADOl. Two 
three-PE machines, named DADOl 3/4 
and DADOl 7/8, were constructed to test 
various nuances of the PE circuit and were 
used to finalize DAD02’s PE design. 

The DADO/DSP, proposed by Gorin,* 
has granularity matched to large vocabu¬ 
lary speech recognition tasks. Raw per¬ 
formance data, reported later, is provided 
specifically for the DAD02 1023-PE 
prototype machine. Future physical reali¬ 
zations, whose engineering details will 
undoubtedly be influenced by experimen¬ 
tation with DAD02, can be expected to 
provide much greater performance. 

DAD02 has demonstrated two impor¬ 
tant principles to date: a 1023-processor 
machine is relatively inexpensive and easy 
to build, and it works. Indeed, DAD02 
was constructed within a university labo¬ 
ratory environment with relatively modest 
support. 

Decomposable 
searching problems 

Decomposable searching problems, 
first identified as an important class by 
John Bentley,^ are well suited to direct 
execution on DADO. Indeed, Bentley 
later proposed, in conjunction with H. T. 
Kung, ^ a specialized binary tree machine 
designed to support this class at high exe¬ 


cution speeds. That binary tree machine 
comprises a number of functional units 
that operate synchronously upon data 
flowing to them, passing results to descen¬ 
dant PEs below in pipeline fashion. 

The proposed machine does indeed pro¬ 
vide a dual binary tree, each tree with its 
own root but both trees sharing the same 
leaves. Hence, data flows down onetree, is 
replicated and operated upon. Final re¬ 
sults are then combined as data continues 
to flow up the second tree (see Figure 2). 

DADO was independently proposed to 
support certain representative members of 
this class of problems with major architec¬ 
tural differences, detailed below. Much of 
this material is based directly upon Bent¬ 
ley’s first paper. 

A static searching problem is defined as 
follows: 

• Preprocess a set F of N objects into an 
internal data structure D. 

• Answer queries about the set F by 
analyzing the structure D. 

Bentley defines three functions of N 
that characterize the complexity of the 
searching problem: 

Sd(N) = the amount of storage re¬ 
quired by D to store the N objects of set F. 

Pd(N) = the preprocessing time re¬ 
quired to build D. 

Qd(N) = the time required to answer a 
query by searching D. 

The membership problem illustrates 
this kind of problem. Preprocess N 
elements of a totally ordered set F such 
that queries of the form “is x in F” can be 
answered quickly. The common solution 
for serial computers is to store F in a sorted 
array D and binary search. Thus, the 
membership problem can be computed on 
sequential computers with complexity 
Sd(N) = N, Pd(N) = 0(N log N), and 
Qd(N) = OOogN). 

A decomposable searching problem is a 
searching problem in which a query asking 
the relationship of a new object x to a set 
of objects F can be written as: 

Query (x, F) = B q (x, 0 
finF 

where B is the repeated application of a 
commutative, associative, binary operator 
b that has an identity and q is a primitive 
query applied between the new object x 
and each element f of F. Hence, member¬ 
ship is a decomposable searching problem 
when cast as 

Member (x, F) = OR equal (x, 0- 
finF 

The nearest neighbor problem, which 
determines for an arbitrary point x in the 
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Figure 2. Bentley and Kung’s tree machine.^ (Source: “Two Papers on a Tree-Structured Parallel Computer,” tech, report, Dept, 
of Computer Science, Carnegie-Mellon University. Courtesy of the author, J. L. Bentley.) 


plane its nearest neighbor in a set F of N 
points, can be cast as 

NN{x, F) = MIN distance(x, f)- 
f in F 

Based on the work of Dobkin and Lip- 
ton,"* Bentley points out that the nearest 
neighbor has serial complexity Sd(N) = 
0{N), Pd(N) = 0(N log N), and Qd(N) 
= 0(log N). 

The key idea about these kinds of prob¬ 
lems is decomposability. To answer a 
query about F, we can combine the an¬ 
swers of the query applied to arbitrary 
subsets of F. This characteristic also 
guarantees quick execution in a parallel 
environment. The idea is simply to parti¬ 
tion the set F into a number of subsets 
equal to the number of available PEs. (For 
pedagogical reasons, we assume a single 
set element f is stored at a PE.) Apply the 
query q in parallel at each PE between the 
unknown x that is communicated to all the 
PEs and the locally-stored set element f. 
Finally, combine the answers in parallel by 
log N repetitions of b. This last step pro¬ 
ceeds by applying N/2 b-computations 
simultaneously between adjacent pairs of 
PEs. The N/2 resultant values are pro¬ 
cessed again in the same fashion. Hence 
N/4 b-computations are applied in paral¬ 
lel, producing N/8 results. After log N 
steps the final single result is computed. 

The minimal savings in a parallel en¬ 
vironment are thus realized by distributing 
the set elements sequentially, obviating the 
need to sort them during preprocessing. 


The query processing time, however, 
seems not to improve in this scheme, re¬ 
quiring Ofiog N) steps in both cases. 
Hence, considering the membership prob¬ 
lem in a parallel environment under this 
scheme, a single query produces 

Sd(N) = N, one element stored in each 
of N PEs. 

Pd(N) = 0(N), sequential distribution 
as opposed to sequential sorting. 

Q D (N) = 0(log N), since log N applica¬ 
tions of b are still required. 

Parallelism appears to provide modest 
savings only in the set-up time. This, in 
fact, is not the case. Significant perfor¬ 
mance savings can be realized in the 
following way. 

First observe, as Bentley and Kung did, 
that a series of queries Queryfxj, F), for 
i=l,...,M can be processed in pipeline 
fashion. In Bentley and Kung’s proposed 
tree machine, queries flow down the tree 
from root to leaves and results flow up 
from leaves to root while being combined 
by operator b. Thus, after distributing F to 
all PEs, a single query can enter the 
parallel machine and begin processing im¬ 
mediately, followed by another query as 
the first query descends one level. After 
Ofiog N) steps, results begin to flow out of 
the parallel machine, one per time step. 
Thus, a series of queries would spend 
O(log N) time filling the pipeline, but then 
be computed in constant time followed by 
Ofiog N) steps to flush the pipe at the end 
of the series. If the number of queries is 


sufficiently large, the pipe filling and 
flushing times can be considered negligi¬ 
ble, and the individual query processing 
time constant. Hence, for large numbers 
of queries Sd(N) = N, Pd(N) = 0(N), 
and Qd(N) = 0(1) for large M. 

Almost decomposable 
searching problems 

The DADO machine is quite different in 
its approach to solving decomposable 
searching problems as well as variations 
that we call almost decomposable search¬ 
ing problems. In a nutshell, queries are 
broadcast to all PEs in the tree in a con¬ 
stant number of instruction cycles. Prim¬ 
itive queries are executed in parallel by all 
PEs. In several important cases the com¬ 
bined result of applying operator b is ob¬ 
tained in one instruction cycle up and out 
of the tree. This mode of operation, re¬ 
ferred to as broadcast/match/resolve/ 
report, will be described with examples 
shortly. First, let me identify several varia¬ 
tions of these kinds of problems to clarify 
the benefits of the approach taken in 
DADO: 

(1) Consider decomposable searching 
problems in which the number of external 
queries is small, or a series of queries are 
generated internally from PEs within the 
tree. Internally-generated queries would 
need to migrate to the root in log N steps 
under Bentley and Kung’s scheme, and be 
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broadcast down once again in log N steps. 
Since each query would force pipe flush¬ 
ing, Qd = 0(log N) for all queries. AI 
production systems in the style of OPS5 
provide an illustration of these kinds of 
problems. 

(2) Consider searching problems where 
the objects are complex or multidimen¬ 
sional, so that a single data structure D 
cannot be constructed. For example, con¬ 
sider relational databases where each ele¬ 
ment of a set is a complex record structure 
with possibly numerous fields or keys. To 
search such records, a data structure D 
would necessarily be needed for each field. 
Hence, in this case Pd(N) ^ kN for k 
fields in each record. 

(3) Consider a set F of first-order 
predicate logic literals: a knowledge base. 
We wish to compute a series of unifica¬ 
tions of a series of goal literals against each 
of the elements of F. Since logic variables 
can bind to arbitrary first-order terms dur¬ 
ing unification, a single query can change 
the entire set of elements in the knowledge 
base by binding and substituting new 
values for variable terms. Successive 
queries, therefore, are processed against 
succeedingly different sets of literals. (The 
simpler case involves frequent modifica¬ 
tions to a dynamic set F, necessitating fre¬ 
quent reconstruction of D. Relational 
databases provide a convenient example.) 
Hence, 

Query (Xi,Fi) = Bq(xi,fi) 
fi in Fi 

where Fj = /Mnct/on(Fi_i,Query(xi_i, 
F i _ 1)). (In the case of logic programming, 
function is substitution after logical 
unification, while for relational databases 
function may be insert or delete.) 

(4) Consider problems where a single 
query in a series of queries cannot be com¬ 
puted without knowing the result of the 
previous query. In dynamic programming 
approaches to statistical pattern-matching 
tasks, a single match of an unknown 
against the set of reference templates can¬ 
not be computed without knowing the best 
match(es) of the previous unknown(s). 
Hence, for a series of unknown Xj, i = 1, 
...,M, 

Query (Xj, F) = B q(Xi, Query(Xi_i, 
F),0. finF 

In this case, the same pipe-flushing 
phenomenon appears as in the first case 
noted above. 

(5) Finally, consider searching problems 
where we wish to compute a number of 
different queries about the same unknown 
X over a set, or possibly different sets. 


Hence, 

Queryi (x, F) = B qjfx, f) for 

i=l.M. finF 

AI PSs provide an illustration of this type 
of problem as well. 

These are the kinds of problems directly 
addressed and supported by the DADO 
machine. Parenthetically, we have, by ex¬ 
ample, identified the very set of applica¬ 
tions for which the DAD02 machine is 
presently being programmed. 

How do we achieve high execution 
speed of these tasks on DADO? 

To begin with, the communication 
model provided by the DADO architec¬ 
ture assumes that broadcast of data to all 
PEs in the machine takes a constant 
number of instruction cycles. That is, 
communicating a single quantity (word) of 
data takes 0(log N) electronic gate delays 
in DADO and not 0(log N) instruction 
cycles via pipelined communication. 

The I/O circuit of DAD02 realizes this 
architectural principle. A single byte of 
data in D AD02 is communicated from the 
root to all 1023 PEs in the machine in one 
processor instruction cycle via the I/O 
chip. A small constant number of addi¬ 
tional machine instructions is necessary to 
move the data to its target location in 
memory. For data larger than one byte, a 
number of broadcast operations are exe¬ 
cuted equal to the length of the datum, 
each byte in a constant number of instruc¬ 
tion cycles. Indeed, the I/O cireuit has 
been conservatively designed to support 
one instruction cycle broadcast per byte 
for up to 8191 PEs. 

Conversely, the I/O circuit also sup¬ 
ports the reporting of a single byte from 
one PE to the root to work in a small con¬ 
stant number of instruction cycles. The ac¬ 
tual elapsed time for broadcast and report 
operations in DAD02 is a constant 25 
microseconds including the memory move 
operations. This key architectural princi¬ 
ple allows for the rapid communication of 
data in and out of the machine. Hence, 
communicating a single data item from 
one PE to all others is achieved in constant 
time, not 0(log N) time, and each of the 
above noted problems may be efficiently 
run on DADO. 

Internally generated queries, as in case 1, 
can be reported and broadcast in a constant 
number of instruction cycles. Similarly, 
case 4 is efficiently handled by the same 
constant instruction-cycle-time broad¬ 
cast/report cycle. In case 2, multiple data 
structures are not needed for DADO. 
Queries about different fields within a 


record can be implemented by broadcast 
of the field location prior to the execution 
of the query. In case 3, the succeedingly 
different sets are computed on the fly in 
SIMD or SPMD mode and left intact in 
each PE while successive queries are con¬ 
tinuously broadcast, each in a constant 
number of instruction cycles. 

Another key capability of the DADO 
machine is to provide direct hardware sup¬ 
port for quickly computing a range of 
commutative and associative binary oper¬ 
ators b. In the membership problem de¬ 
fined above, the binary operator OR is 
repeatedly applied to all of the results of 
the primitive query equal (x, f). In a se¬ 
quential environment, this operation may 
require linear time to compute. In a paral¬ 
lel environment, it can be computed in log 
time. On DADO, it is computed in con¬ 
stant instruction cycle time. 

The I/O circuit of DAD02 provides a 
high speed function that we call min- 
resolve. The min-resolve circuitry 
calculates in one instruction cycle the 
minimum value of a set of values distrib¬ 
uted one to a PE. Not only is the minimum 
value reported in a single instruction cycle, 
but the PE with the minimum value is set 
to what is called the “winner state,” in¬ 
dicating the entire ensemble of loser PEs 
as well as the single winner PE in the com¬ 
putation. (Ties are arbitrated in hardware 
according to a fixed PE ordering scheme.) 

The membership problem can thus be 
solved by applying min-resolve to zeros 
and ones (distributed throughout the tree 
after complementing the result of the 
equality operator) to compute OR. The 
nearest neighbor can be computed by ap¬ 
plying min-resolve to the distances. 
(Similarly, data generated within DADO 
can be read in sorted order in 0(N) time by 
sequential enumeration of min-resolved 
winners.) 

Finally, note that problems character¬ 
ized by the fifth example can be efficient¬ 
ly supported by the MSIMD mode of 
operation. In this case, DADO can be ar¬ 
bitrarily partitioned into a number of 
smaller sub-DADOs, each executing a 
distinct task. Each sub-DADO can thus 
process its own query, while a forest of 
sub-DADOs can compute a number of 
queries concurrently. 

Let us now review how the DADO 
machine can quickly execute decom¬ 
posable searching problems as well as the 
more difficult class identified by the five 
observations. Membership will provide 
the vehicle for illustration. 
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DAD02 Prototype,” J. of Parallel and Distributed Computing, Vol. 3, No. 2, June 
1986, p. 279. Courtesy of the publisher. Academic Press.) 


(1) Preprocess N objects of set F by 
distributing each element in turn to one PE 
of DADO. Note, Sd(N) = N for the en¬ 
tire machine and Pd(N) = N. 

(2) Broadcast the unknown object x to 
all PEs in a constant number of instruction 
cycles. 

(3) Apply the query equal (x, f) in paral¬ 
lel at each PE (in SIMD or SPMD mode). 
In parallel, each PE sets the min-resolve 
value to 0 if X = f, otherwise it sets it to 1. 

(4) Min-resolve in one instruction cycle. 

The overall computation time for 

Qd(N) = 0(1), the sum of steps 2, 3, and 
4. In cases where the primitive query q is 
more complex than equality, the running 
time is proportional to the slowest of the 
entire set of concurrent executions of q. 

Production systems on DADO. Anoth¬ 
er illustration is provided by AI PSs. In 
general, a PS is defined by a set of rules, or 
productions, which form the production 
memory (PM), together with a database of 
assertions, called the working memory 
(WM). Each production consists of a con¬ 
junction of condition elements, called the 
left-hand side (LHS) of the rule, along 
with a set of actions called the right-hand 
side (RHS). The RHS specifies informa¬ 
tion to be added to (asserted) or removed 
from WM when the LHS successfully 
matches against the contents of WM. 

In operation, the P§ repeatedly executes 
the following cycle of operations: 

(1) Match: For each rule, determine 
whether the LHS matches the current en¬ 
vironment of WM. All matching instances 
of the rules are collected in the conflict set 
of rules. 

(2) Select: Choose exactly one of the 
matching rules according to some prede¬ 
fined criterion. 

(3) Act: Add to or delete from WM all 
assertions specified in the RHS of the 
selected rule. 

An AI PS can be cast as an almost 
decomposable searching problem by 
repeatedly applying the query 

Query(WMj, PM) = MAX match (r, 
r in PM 

WMj) for i= 1,...,M for some M 
where WMj = WM on the i-th cycle com¬ 
puted by applying the selected rule on the 
i-lstcycletoWMi_i. (WM „ is the ini¬ 
tial WM.) Match is a function that calcu¬ 
lates whether a rule matches the current 
WM and rates the quality of the match by 
some predefined criteria. 

One of the simplest reported algorithms 
(named the Full Distribution Algorithm) 


for PS execution on DADO works by dis¬ 
tributing a single rule to each of the 
available PEs. Data in WM is broadcast in 
turn to all PEs, which match it against the 
stored rule, saving those data elements 
that match some condition element of the 
LHS of their rule. Rules whose LHSs are 
thus fully matched are then resolved to 
determine the single rule instance to exe¬ 
cute. The RHS actions of the selected rule 
are then broadcast to all other PEs, ini¬ 
tiating another match cycle. In effect, the 
entire rule base is fully distributed into a 
collection of one-rule PSs processed in 
parallel. 

In certain contexts, the primitive query 
match can itself be cast as an almost de¬ 
composable searching problem. The 
match of a single rule requires the match 
of each condition element in its LHS 
against the database of WM elements. 
Thus, given the stylized rule 
Cl C2 ... Cm-*-Ai ... An, 
match can be considered a conjunction of 
queries: 

Queryj(Cj, WM;) = OR primitive- 
w in WMj 

match(Cj,w), for j = 1,...,M 
or, when variable bindings between condi¬ 
tion elements are possible, 

Queryj(Cj, WMj) = OR primitive- 
win WMj 

match (Cj, Queryj_,(Cj_ 1 , WMj), w) 
forj = 2,...,M. 


Primitive-match is the lowest level test of 
an individual condition against a specific 
data element in WM. This leads to yet 
another parallel algorithm for AI PSs 
utilizing the MSIMD mode of operation 
of DADO. In this case, each rule matched 
appears in the root PE of a sub-DADO. 
These root PEs appear at one level of the 
machine called the PM-level (see Figure 3). 
Each sub-DADO, and hence each distinct 
rule, is matched in parallel against the WM 
elements fully distributed to the WM- 
subtrees below. The final accumulated 
result of the concurrent rule matchings is 
computed by a higher-level parallel pro¬ 
cess similar to the one depicted in the first 
PS example. 

The stylized algorithm (named the 
Original DADO Algorithm) proceeds as 
follows: 

(1) Initialize: Distribute a match routine 
and a distinct rule to each PM-level 
PE. Set Changes to the initial WM 
elements. 

(2) Repeat the following: 

(3) Act: For each WM-change in 
Changes, do 

(a) Broadcast WM-change to the 
WM-subtree PEs that modify 
themselves accordingly. 

(b) Initiate the parallel match phase 
in each PM-level PE: 

(i) Each condition element of the 
rules (the Cj noted above) 
stored at a PM-level PE is 
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broadcast to the WM-subtree 
below for primitive matching, 
(ii) A local conflict set of rules is 
formed along with a priority 
rating. 

(c) End do. 

(4) Select: The min-resolve circuit is 
used to identify the maximally-rated 
conflict set instance from all PM- 
level PEs. 

(5) Report the instantiated RHS of the 
winning instance to the root of 
DADO. 

(6) Set Changes to the reported action 
specifications. 

(7) End Repeat. 

These algorithms, as well as other 
variants, have been reported elsewhere^ 
and are either presently running or under 
development on DAD02. 

The question to ask at this point is, 
precisely what speedup can be achieved for 
AI PS programs? Much has been written 
and debated about this very point. The 
issue centers upon two key observations. 

First, the match function itself is exe¬ 
cuted in parallel by a large number of 
PEs. In certain measured OPS5 PS pro¬ 
grams, it has been reported that a rela¬ 
tively small and stable number of rules 
must be matched on each cycle of PS exe¬ 
cution. That is, on average each rule firing 
in OPS5 produces new data elements that 
affect (or are relevant to) the LHS of a 
small number of rules. (Statistics for Rl, 
for example, show that about 30 rules out 
of a set of approximately 2000 are affected 
on each cycle of execution.) This small af¬ 
fect set, as it has been called, thus indicates 
that the number of individual match 
operations executing in parallel that com¬ 
pute useful new matching rule instances is 
small. Hence, a large number of invoked 
parallel procedures compute nothing at all 
and the utilization of the parallel resources 
is poor. (The well-known RETE match 
algorithm for OPS exploits this observa¬ 
tion by utilizing a discrimination network 
data structure—D in the characterization 
above—that links rules to be matched with 
newly inserted WM elements. Sequential 
OPS is thus executed much more efficient¬ 
ly than purely naive sequential matching 
approaches.) 

The second observation to note is that 
the variance in processing times for the 
concurrent match operations can be quite 
large. That is, the total running time is pro¬ 
portional to the slowest match operation, 
indicating that utilization of the parallel 
resources may decrease even further while 
possibly many PEs wait for the slower PEs 


to catch up and synchronize for the resolve 
operation. 

These two observations may lead one to 
the depressing view that PS programs, in 
particular OPS5, can best be accelerated 
by a small number of parallel processors 
rather than the large-scale approach taken 
in the DADO machine. We on the DADO 
project believe this very point requires fur¬ 
ther investigation. The DADO project at 
Columbia has discovered and is im¬ 
plementing two clever source-to-source 
transformational techniques as well as a 
multitasking approach that provide the 
means to reduce the rule-matching vari¬ 
ance time as well as increase the average af¬ 
fect set size. 

Unfortunately, space does not permit a 
detailed review of this work. I encourage 
the reader to refer to other papers*’^ for 
details of these approaches. The essence is 
to rewrite the rule system in such a way 
that individual rules that require more 
processing than the average rule are 
replicated a number of times with addi¬ 
tional distinct constraints appearing in 
each copy. This transformation preserves 
the same computation as the original rule, 
but provides the opportunity to match the 
copied rules in parallel. The total effect is 
that a number of rules representing the 
single “hot spot” rule can more quickly 
calculate the same result in parallel. 
Results reported in the last section show 
how one system was optimized in this 
fashion to produce a speedup of 31 over a 
VAX computer. 

The second technique to increase the 
average affect set size depends upon con- 
curreht rule firings, where the select phase 
chooses for parallel e.iccution as large a 
number of rule instances as possible, 
rather than a single rule instance. A 
multitasking approach to this parallel ac¬ 
tivity on DAD02 has been reported * with 
encouraging simulation results noted: a 
factor of 7.5 times faster execution for a 
237-rule OPS5 program. 

Another technique is quite similar to the 
notion of “chunking” introduced by 
Rosenbloom.® Whereas chunking has 
been proposed as an AI learning method, 
the same technique may be used to 
coalesce a number of rules into larger rules 
with larger RHSs. The net effect is to 
rewrite a set of individual rules often exe¬ 
cuted serially to a new larger rule (encom¬ 
passing all the others) whose actions com¬ 
pute the same WM changes and hence 
create larger affect sets in one cycle of exe¬ 
cution. Consequently, the execution of a 
single chunked rple, in place of its fore¬ 


bears, can lead to a larger number of 
useful match operations calculated in 
parallel. 

One experiment performed to date pro¬ 
vides evidence to support the utility of the 
third approach. An OPS5 program, 
named Puzzle2 (appearing later in Table 
2), ran nearly twice as fast on DAD02 
using the chunking approach. Combined 
with the copying and constraining tech¬ 
nique, Puzzle2 ran 18 times faster on 
DAD02 than on a VAX. Hence, it is defi¬ 
nitely possible to enhance performance 
through the application of program trans¬ 
formation techniques to extract further 
parallelism than appears on the surface. 
Work is presently under way to apply these 
techniques to a larger OPS5 program to be 
run on DAD02. 

One final word about PS performance. 
Much of the debate that has arisen is based 
upon statistics derived from the perfor¬ 
mance of existing sequential OPS5 pro¬ 
grams. Many parallel processing 
researchers concur that opportunities for 
exploiting parallel processing may not be 
derived from the study of only sequential 
programs. After all, sequential programs 
were written for sequential processors, not 
parallel processors. This may lead re¬ 
searchers toward techniques of conven¬ 
tional program optimization to improve 
code efficiency on a single PE, the primary 
approach taken in the implementation of 
OPS83. “ We prefer to optimize for in¬ 
creased parallel performance. Hence, a 
potentially more useful approach may be 
to consider rewriting existing sequential 
code entirely with the mind’s eye set on 
parallel processing. (Fortunately, not 
many lines of OPS code exist in compari¬ 
son to Fortran, for example.) To that end, 
expression of parallelism is necessary and 
hence parallel languages are vitally 
important. 

Much of the current activity of the 
DADO project at Columbia focuses on 
the specification and implementation of 
an AI PS language, called HerbAl, de¬ 
signed to be downward compatible with 
OPS5. The essence of the initial HerbAl 
definition provides a few additional 
parallel constructs to permit the expres¬ 
sion of inherently parallel activities that 
can be expressed only sequentially in OPS. 
The expected net result is to provide im¬ 
proved expression as well as improved per¬ 
formance of AI programs (see van 
Biema*^ for details of spme initial ex¬ 
periments). We expect that the initial 
HerbAl effort will provide a brighter 
future for large-scale parallel processors. 
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Programming DADO 

The other examples identified above 
(logic programming, relational database 
operations, and statistical pattern recogni¬ 
tion) can be similarly defined as almost 
decomposable searching problems. Each 
of these problems shares the same com¬ 
mon programming paradigm on DADO: 

• Distribution of an initial set of data. 

• Broadcast of data in a constant 
number of instruction cycles. 

• Local execution of some primitive 
query against a prestored element of 
the reference set (unification of first- 
order logic literals, relational selection 
of tuples, and dynamic time-warp 
match of a template of a speech ut¬ 
terance, respectively). 

• Resolution to find the best answer in a 
constant number of instruction 
cycles. 

• Report of the final answer. 

To date, three high-level parallel pro¬ 
gramming languages are available on 
DAD02 for expressing these computa¬ 
tions. Each is based upon the same princi¬ 
ple, whereby a small set of parallel pro¬ 
cessing and communication primitives are 
added to a familiar high-level conven¬ 
tional language. Hence, parallel PL/M 
(PPL/M), parallel C, and parallel PSL 
Lisp (PPSL) all share a common ex¬ 
pressive formalism for parallelism, but a 
different base language. These languages 
have been reported elsewhere.'^-*'* I 
demonstrate the Member example in 
parallel C to convey the flavor of the cur¬ 
rent style of programming DAD02. (This 
example forms the basis of the relational 
selection implementation whose perfor¬ 
mance I detail later.) 

SIMD variables (f in the following ex¬ 
ample) correspond to vectors whose com¬ 
ponents are fully distributed to the PEs, 
that may be operated upon, in whole or in 
part, in parallel. 

simd char f: 

member(x) 

I 

return (minresolve(broadcast(x) ! = f)): 

I 

In the following section I detail the per¬ 
formance of two almost decomposable 
searching problems appearing in relational 
database operations and OPS5 PSs. 
Statistical pattern recognition examples 
will be reported elsewhere. Logic pro¬ 
gramming examples are not yet available. 


Table 1. Tunings In seconds for SELECT * FROM < table> WHERE < field > = 

< literal > on DAD02 and IBM 4381. The key Is a fixed length 5 character string. 
Timings were averaged over 10 runs for each size reported. 

Number of 
Records 

IBM 4381 

SQL 

DAD02 

Speed-up 

IK 

0.042 

0.0056 

7 

4K 

0.141 

0.0224 

6 

8K 

0.265 

0.0448 

6 


Perforaiance 

The contenders in this tournament are 

• an IBM 4381 running VM/CMS in a 
main memory of 16M bytes, 

• a VAX 750 running BSD Unix 4.2 in a 
configuration of 6M bytes of main 
memory, 

• the DAD02 prototype machine with 
1023 8-bit processing elements, each 
with 16K bytes of user memory, total¬ 
ing roughly 16M bytes. DAD02 was 
hosted in all cases by a VAX 750 run¬ 
ning Unix 4.2. 

The relational database benchmarks 
were run on the IBM mainframe using 
IBM’s SQL system. The AI PS bench¬ 
marks were run on the VAX alone using a 
compiled version of CMU’s widely 
distributed OPS5 system. All benchmarks 
were run on DAD02 using parallel C with 
a VAX 750 host running Unix. Each 
benchmark is described in turn. 

Relational database operations. The 
primary operation tested was relational 
selection on a variety of different sets of 
32-character tuples. Each relation ranged 
in size from 1023 to 8191 tuples in the 
benchmarks reported here. All times 
reported in Table 1 are absolute times for 
precisely the same operations running on 
each machine. 

Disk transfer rates are intentionally ig¬ 
nored in these timings. Since DADO is 
designed as an attached peripheral, we in¬ 
tend the machine to simply offload pro¬ 
cessing from a mainframe’s processing 
unit. Hence, external-to-internal transfer 
rates are considered the same for a main¬ 
frame both with and without the DADO 
peripheral. 1 therefore report only the per¬ 
formance of the two machines executing 
purely searching code for the relational 
selection task against databases contained 
solely in main memory. 

As Table 1 indicates, DAD02 is six 
times faster in selecting data over the IBM 


4381 processing unit. Clearly, selection 
runs fast as a purely decomposable search¬ 
ing problem. Why is DAD02 not 1023 
times faster than the IBM 4381? 

One key observation must be made and 
understood before proceeding. The theo¬ 
retical speedups discussed earlier must be 
viewed in relation to a single PE within 
DAD02. That is, 1023 PEs should be 1023 
times faster than one PE. Each DAD02 
PE is a simple 8-bit Intel 8751 processor 
pitted against a huge Goliath IBM 4381. 
Even so, 1023 Davids beat the Goliath sbc 
times over for selection. 

Rating the single PE’s performance 
against the IBM would provide perhaps 
more useful data. However, executing the 
programs reported here in a Single 
DAD02 PE would be quite difficult if not 
impossible due to the severely limited ad¬ 
dress space available for the prototype PE. 
Hence, we measure DAD02 in compari¬ 
son to conventional computers with suffi¬ 
cient capacity to store the sanle programs 
in their main memories. The following 
benchmarks should be understood in this 
context. (Our next stage of research will be 
devoted to measuring speedups directly in 
terms of processor utilization to provide a 
better understanding of the spefedups 
achievable by parallel processors such as 
DADO.) 

AI production systems. We measured 
the time to process RHS actions of rules, 
additions and deletions of WM elements, 
and the time to match the newly formed 
database against the rule base. The 
TREAT algorithm, developed by Mir- 
anker, was implemented in the style of 
the first PS algorithm discussed above 
(Full Distribution). No optimizations were 
performed on the DAD02 code. The rules 
were loaded sequentially and randomly 
distributed throughout the machine. 
Thus, the rated performance must be 
viewed as an upper bound and will un¬ 
doubtedly significantly improve in the 
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Table 2. DAD02 versus a VAX 750 for OPS5 rule matching (timings in millisec¬ 
onds). 

PS Name 

#Rules 

#WM 

#DADOPEs 

VAX 

DAD02 

Speed-up 
over 750 

Mapper 

237 

528 

287 

68,119 

9,696 

7 

Monkeys 

13 

12 

13 

2,240 

754 

3 

Puzzle 1 

13 

65 

137 

313,344 

28,663 

11 

Puzzle 2 

13 

65 

137 

313,344 

17,850 

18 

Puzzle 3 

13 

65 

438 

313,344 

10,028 

31 

Waltz 

33 

50 

50 

77,350 

34,873 

2 

Mud 

884 

241 

943 

675,172 

338,844 

2 


future when our optimization techniques 
are fully Implemented. 

In several of the cases reported below, 
the copy-and-constrain technique was 
used with encouraging results. As noted, 
one program implemented utilized the 
chunking technique and produced signifi¬ 
cant performance gains, providing evi¬ 
dence of the efficacy of this approach as 
well. 

In the present implementation, only the 
match phase (which processes the LHS of 
distributed rules) is executed directly on 
DAD02. The instantiation of the RHS of 
the selected rule is performed by the host 
VAX. This initial implementation pays a 
modest price in performance. The instan¬ 
tiation of the selected rule is reported to 
the VAX in its entirety. The VAX then pro¬ 
ceeds to compute the instantiation of the 
RHS (stored in its memory). The cost of 
communicating the entire instantiated 
LHS could be avoided by having the win¬ 
ning PE in the selection phase perform this 
computation directly. This bottleneck has 
become our primary target for further per¬ 
formance gains in the current implementa¬ 
tion effort. 

The programs executed consisted of 
from 13 to 884 OPS5 rules and from 12 to 
528 WM elements. Measurements were 
made of the total time to execute the rule 
system over a large number of rule execu¬ 
tion cycles. 

Included in Table 2 are the number of 
PEs used in the computation on DAD02. 
This indicates the number of additional 
copied and constrained rules introduced to 
the initial systems to boost performance. 
Notice that in no case have the fully 
available DAD02 PEs been used in these 
initial benchmark programs. Hence, only 
a fraction of the machine has been rated. 

Of particular Interest is the performance 
of the programs called Mapper and 
Puzzles, respectively 7 and 31 times faster 


than a VAX 750. These programs perform 
best on DAD02 simply because of the 
amount of matching tasks they require 
that can be executed in parallel. A perusal 
of Table 2 confirms that the larger the 
number of data elements to match relative 
to the number of rules, the more matching 
tasks that need to be executed. Hence, the 
speedup is greater, in general, for programs 
that have proportionately more data ele¬ 
ments than rules. Note, for example, that 
Mud is only twice as fast on DAD02 as on 
the VAX, where 241 data elements are 
matched against over 800 rules. 

The performance of Puzzle2 confirms 
that the approach of chunking rules may 
provide greater performance advantages. 
When combined with a smaller degree of 
copying and constraining in the Puzzle 1 
program, a multiplicative effect was 
measured where overall performance was 
boosted to a factor of 18, up from a factor 
of 11. 

It is clear from these initial performance 
figures that indeed there are additional 
sourees of parallelism and eoneomitant 
speedup to be explored for AI PSs. Earlier 
pessimistic statistics published for OPS5 
must thus be considered too negative. 

Our next year of research is devoted to 
producing a wide range of experiments on 
a large number of OPS5 programs to fully 
understand the effects of these various op¬ 
timization techniques. We are encouraged 
to believe by these initial measurements 
that even greater performance gains for 
DAD02 are thus achievable. 


A s a final note: DAD02 has initial¬ 
ly displayed a modest range of 
performance gains over two serial 
machines for two almost deeomposable 
searehing problems. There is one very im¬ 
portant question that should not be lost by 
any parallel architect: At what cost? Here 


is where DAD02 is perhaps at its best. 
DAD02’s physical characteristics and 
hardware complexity are roughly equiva¬ 
lent to a VAX 750 (including the age of 
their respective technologies). DAD02, 
however, is much smaller and less expen¬ 
sive than an IBM 4381. Indeed, DAD02 is 
considered an attached peripheral for each 
machine. In the case of the VAX, hard¬ 
ware is doubled (although the full DAD02 
machine is not employed) for at least a fac¬ 
tor of from 2 to 31 gained in performance 
for OPS5 rule-matching for a modest col¬ 
lection of programs. In the case of an IBM 
4381, a small add-on peripheral produces 
a factor of six gained in performance for 
relational seleetion. 

This data suggests that DADO is a good 
cost/performance peripheral for almost 
decomposable searching problems. Data 
to be reported elsewhere by researehers at 
AT&T Bell Laboratories showing signifi¬ 
cant speedup of statistieal pattern recogni¬ 
tion tasks on DAD02 will substantiate this 
claim as well. □ 
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Some of the nation’s most excit¬ 
ing developments in software 
technology, supercomputer 
architecture, AI, and expert sys¬ 
tems are under scrutiny right 
now at the Institute for Defense 
Analyses. IDA is a Federally 
Funded Research and Develop¬ 
ment Center serving the Office of 
Secretary of Defense, the Joint 
Chiefs of Staff, Defense Agen¬ 
cies, and other Federal sponsors. 

IDA’s Computer and Software 
Engineering Division (CSED) is 
seeking professional staff 
members with an in-depth theo¬ 
retical and practical background 
in Programming Languages. 
Tasks include efforts on both 
compiler-based tools for pro¬ 
gram development and testing 
and on language validation. 

Tasks include efforts both in 
prototyping tools and in advising 
the DoD on policies for lan¬ 
guage development and mainte¬ 
nance. The emphases of the Div¬ 
ision’s efforts are in Ada and 
logic programming languages. 

Specific desired interests and 
skills include theory and practi¬ 
cal experience in: 

• Compilers and compiler 
generators 

• Code optimization 

• Language validation 

• Formal semantic 
representation 

• Formal representation for 
requirements/designs 


• Design and rationale of Ada 

• Language directed dynamic 
computer architectures 

Specialists in other areas of 
Computer Science are also 
sought; Software Engineers, Dis¬ 
tributed Systems, Ai^cial Intel¬ 
ligence and Expert Systems, and 
Computer Security Specialists. 

We offer career opportunities at 
many levels of experience. You 
may be a highly experienced 
individual able to lead IDA proj¬ 
ects and programs ... or a 
recent MS/PhD graduate. You 
can expect a competitive salary, 
excellent benefits, and a superior 
professional environment. 
Equally important, you can 
expect a role on the leading edge 
of the state of the art in comput¬ 
ing. If this kind of future appeals 
to you, we urge you to investi¬ 
gate a career with IDA. Please 
forward your resume to: 

Mr. Thomas J. Shirhall 
Manager of Professional Staffing 
Institute for Defense Analyses 
1801 N. Beauregard Street 
Alexandria, VA 22311 

An equal opportunity employer. 
U.S. Citizenship is required. 
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Applications of the 
Connection Machine 


This massively 
parallel system is 
easily programmable, 
applicable to a variety 
of applications, and 
can be scaled to large 
problems by the 
addition of more 
processors. 
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T he Connection Machine develop¬ 
ment effort* was initiated in the 
belief that parallel processing and 
artificial intelligence could together ac¬ 
celerate the rate of progress toward truly 
intelligent machines. In the brief time since 
the first Connection Machine was switched 
on in April 1985, we have begun to realize 
this dream at a pace and with an ease that 
has far exceeded our expectations. This 
progress is the result of the ease with which 
the machine can be programmed and the 
dramatic increase in compute power that 
the machine can bring to bear.* We have 
been able to run many trials of experi¬ 
ments in instances where previously, run¬ 
ning just one would hkve been considered 
an achievement and no further experimen¬ 
tation would have been done. This has 
enabled us to explore a great many more 
hypotheses and to work on much larger 
problems than had been possible on previ¬ 
ous-generation artificial intelligence 
workstations. The ease of programming is 
in part the result of a decision to use ex¬ 
isting serial machines (the Symbolics 3600 
or Digital Equipment Corporation VAX), 
thus leaving unchanged the operating sys¬ 
tems, editors, file systems, debuggers, net¬ 
work communications systems, and so on, 
so as to provide familiar programming en¬ 
vironments. The Connection Machine is 
programmed in conservative extensions of 
Common Lisp and C. Users familiar with 
these languages and with front-end com¬ 
puter systems have been able to produce 
results on the Connection Machine on the 
first day that they use it. 


•The Connection Machine can perform most opera¬ 
tions at a rate in excess of 1000 MIPS; 32-bit addition 
operates at more than 2000 MIPS. As a comparison, 
note that a DEC VAX 11/780 operates at about I 
MIPS. {MIPS = millions of instructions per second.) 
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Data-level parallelism. Programming 
the CM has proven to be easy. Because 
there are so many processors, it is prac¬ 
tically Impossible to program each one 
separately. Instead, the programming 
method we have generally used, called 
data-level parallelism, is similar to that 
used on ordinary serial machines. * * In this 
method, each element of data for the 
problem is stored, and one element is 
stored per processor (or virtual processor). 
The front-end computer executes a serial 
program, each step of which can involve 
computations in all of the Connection 
Machine’s processors. For example, 
rather than using loops for repetitively 
computing operations on an array or set of 
data elements, one serial program carries 
out the operations simultaneously in all of 
the processors. 

Such a solution seems far more natural 
and easy to construct than those typically 
proposed or implemented for coarse¬ 
grained parallel machines. Coarse-grained 
parallel computers (ones with two to a 
hundred or so processors) must generally 
be programmed by means of a method 
that might aptly be called “control-level 
parallelism.” Control-level parallelism re¬ 
quires a programmer to divide a program 
into fragments, one for each of the pro¬ 
cessors in the coarse-grained machine. 
Synchronization is a problem in coarse¬ 
grained systems; moreover, it is often not 
easy to find parallelism in programs, let 
alone exactly the right amount of paral¬ 
lelism—that is, an amount that can be 
distributed equally among the number of 
available processors. 


••Not all Connection Machine programs exploit data- 
level parallelism. For an example of Connection 
Machine programming that assigns different opera¬ 
tions to different processors, see Blelloch. ^ 
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In a wide variety of cases, we have dem¬ 
onstrated that the Connection Machine 
can exploit data-level parallelism to 
achieve high computation rates. Data- 
level parallelism is particularly ap¬ 
propriate for database, natural-language, 
and image-processing operations, for 
finite-element modeling, graphics, and 
automata-based modeling of physical 
processes. 

Hardware and software: system-level 
specifications. The CM system is at the 
“radically fine-grained” end of the spec¬ 
trum of parallel machines; it is available in 
configurations ranging from 16K (2''*) 
processor-memory units up to a maximum 
of 64K (2'®). The processor-memory units 
are interconnected with a high-speed com¬ 
munications network that allows ah pro¬ 
cessors to communicate with any or all 
other processors that are in parallel. The 
64K Connection Machine system consists 


of the processor-memory-communica¬ 
tions system plus a front-end machine. 

A Connection Machine system supports 
up to eight front-end computers. Current¬ 
ly, each front end is either a Digital Equip¬ 
ment VAX or a Symbolics 3600 Series Lisp 
Machine. Physically, the Connection 
Machine consists of 4096 chips of pro¬ 
prietary design, each containing 16 pro¬ 
cessors plus a hardware router. The CMs 
on which most of the benchmarks in this 
article were run consist of 16K processors, 
each with 8M bytes of memory (4K bits per 
processor). Processors operate in a bit 
serial fashion: each operation can com¬ 
bine two bits from memory with one bit 
from a register, producing one bit to 
memory and one bit to a register. Each of 
these basic load-load-store operation 
cycles requires about one microsecond. 

The processors are organized as a 
12-dimensional hypercube with 16 pro¬ 
cessors at each vertex of the hypercube. A 


packet-switching network handles com¬ 
munication between the processors. Each 
16-processor chip also contains a network 
router. Each router can accept a message 
from one of the processors on its chip (or 
from a router on a different chip) and send 
it to either a processor on its chip or 
another router on a different chip. Each 
router can also buffer messages if there are 
no channels available over which to send 
them. A message header consists of 16 
bits; each bit corresponds to a dimension 
along which the message must move in 
order to be delivered properly. The header 
can be computed by comparing the 16-bit 
address of the source processor with the 
16-bit address of the destination pro¬ 
cessor, putting ones in each dimension in 
which the addresses differ. Each time the 
message is routed along a dimension of the 
machine, the bit corresponding to that 
dimension is set to zero. When all the bits 
are zero, the message has arrived at its 
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destination. Messages can be combined by 
means of four operations: or, max, add, 
or overwrite. Typical message delivery 
times when all processors send messages 
are on the order of 250 microseconds for 
32-bit messages; times range from 70 
microseconds for very regular communi¬ 
cations patterns to a worst case of 900 
microseconds when all processors send to 
other processors at random. 

Parallel channels support I/O rates of 
up to 2000M bps. The channel supports 
very-high-speed devices, such as disks and 
frame buffers. 

Each processor can, under software 
control, mimic a number of virtual pro¬ 
cessors. To accomplish this, the memory 
of each processor is divided up so that each 
“virtual processor” operates on a smaller 
amount of memory. We have routinely 
programmed applications involving a mil¬ 
lion virtual processors. The speed penalty 
for computation is approximately linear. 
Thus, going to n virtual processors per 
processor slows down the computation by 
a factor of «; there is very little overhead. 

The CM can be programmed at the 
front end with C *, which is an extension 
of C, or * LISP, an extension of Common 
Lisp. To the programmer, the front-end 
machine appears essentially unchanged: 
The same file systems, editors, debuggers, 
network protocols, and so on are avail¬ 
able. The only difference is that a set of ad¬ 
ditional instructions and parallel struc¬ 
tures is available in each programming 
language. There are parallel analogs of 
most common instructions. For example, 
the expression 
(+!!«*) 

can simultaneously add and store: It can 
carry out the addition of variables stored 
in field a in each of 64K processors to the 
contents of each of 64K instances of the 
variable b, and store the result on an inter¬ 
nal stack within each processor. Other 
*Lisp constructs are also natural exten¬ 
sions of well-known operations. For in¬ 
stance, (♦if test operations) executes the 
test and then executes the operations only 
in those processors in which the test suc¬ 
ceeded. (The “currently selected set” of 
processors may, of course, be further 
restricted by including another “♦if” 
among the operations.) Examples of 
♦ Lisp and C ♦ code for the Connection 
Machine are given in the section on “Pro¬ 
gramming a document-retrieval system,” 
below. 

The raw computing rate of the machine 
is on the order of 64,000 MIPS for single¬ 


bit instructions. If the machine is operat¬ 
ing on units larger than a bit (for instance, 
a 32-bit number) then the raw computa¬ 
tion speed must be divided by the number 
of bits in the word to achieve a measure of 
the actual computing rate. Thus, the CM 
performs 32-bit adds at a rate of approx¬ 
imately 64,000-:-32-f 2000 MIPS. For 
database applications, the relevant word 
length may be only one byte, and may 
sometimes be as short as a bit. As a result, 
for these applications we have bench- 
marked very high performance, approx¬ 
imately equivalent to a serial machine 
operating at 6000 MIPS. 

Document retrieval 

We have built an easy-to-use document- 
retrieval system that mixes AI ideas with 
methods derived from the information- 
science research of the 1960’s. ^ Its basis is 
a weighted associative-memory algorithm. 
Document retrieval has traditionally been 
implemented as Boolean search on an in¬ 
verted file. The main difficulties of Boolean 
search are 

• users require considerable training in 
the use of a query language, and 

• users generally alternate between be¬ 
ing overwhelmed by too many docu¬ 
ments (if one uses a search pattern 
that is too general) or being given too 
few documents (if one’s search pat¬ 
tern is more restrictive). 

Boolean search systems also exhibit poor 
precision and recall. In constrast, a naive 
user can be trained to use our system in a 
few minutes; the system operates very 
rapidly; and the system has high precision 
and recall. 

Document retrieval by “relevance feed¬ 
back.” From the user’s point of view, the 
search process on the Connection Ma¬ 
chine document retrieval system has two 
distinct phases. 

In the first phase, the user types a list of 
a few keywords or a question. In Figure I, 
for example, the user has typed “Marcos,” 
and “Wealth.” The front-end machine 
broadcasts coded forms of each of these 
two words to all processors; it also broad¬ 
casts numerical weights. Each processor 
notes whether each word occurs in its arti¬ 
cle; if a word appears, it increments the 
score of its article by the appropriate 
numerical score. The weight assigned to a 
word is inversely proportional to the log of 
its frequency in the database. (For exam¬ 
ple, “platinum” appears in the database 


less frequently than “gold,” and therefore 
has a higher associated weight). This 
weighting mechanism ensures that uncom¬ 
mon words have more of an influence than 
common words do over which content 
kernels get selected during the document- 
lookup process. As long as the terms in the 
search profile are all from closely related 
articles, the longer the search profile, the 
more precise the search. 

When all the words have been broad¬ 
cast, the articles with the largest seores are 
retrieved and presented to the user. 

In the second phase, the user can browse 
through the documents returned and find 
one or more documents that bear on the 
topic of interest. Our interface allows the 
user to use a mouse to mark documents as 
“good” or “bad.” Once one or more 
documents have been marked, the user 
can repeat the search again. This time, all 
the words in the document or documents 
selected are broadcast. The documents 
that are most relevant will share a large 
number of words with the selected, or 
“seed,” document. The results of such a 
search are shown in Figure 2. This 
method, termed relevance search, has 
been known since the 1960’s to have ex¬ 
cellent properties of precision and recall, 
but to the best of our knowledge, it has 
never been used in a practical system 
because of its extremely high computa¬ 
tional requirements. 

The algorithm takes advantage of the 
innate characteristics of documents. Every 
document is, in effect, a thesaurus for its 
subject matter. A high percentage of the 
synonyms for each topic appear because 
writers work to avoid repetition. In addi¬ 
tion, variants of words (such as plural, 
singular, and possessive forms), and 
semantically related terms also appear 
among the words in a particular article. 
Clearly not every synonym, variant, and 
related term will occur in a single article, 
but many of the related terms will. The use 
of many terms to form a search pattern 
makes the search highly selective. While 
the word “chip” may appear in an article 
about cookies, “VLSI,” “integrated,” 
and “circuit” simply will not. In the 
overall scoring, truly useful documents are 
reliably separated from random matches. 

Seed-document search requires only 
about 40 milliseconds on the Connection 
Machine, given a 200-term search pattern 
and about 3K bytes of free text per CM 
processor. A more detailed discussion of 
performance appears in the section on 
“Timing and performance,” below. 
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Building a database on the Connection 
Machine system. The document database 
is constructed from sources of text, such as 
wire services, electronic mail, and other 
electronic databases. The system we have 
used for benchmarking contains about 
15,000 Reuters news wire articles. One arti¬ 
cle is stored per processor; each article 
averages on the order of 3000 bytes of 
ASCII data. The text of the articles is com¬ 
pressed by means of techniques described 
below, so that the 3000 bytes are encoded 
in about 500 bytes. For that description, it 
is important to draw a distinction between 



memory of the Connection Machine 
system. 

The content kernel is produced auto¬ 
matically from the source document. 
First, the source document is processed by 
ConText, a Thinking Machines Corpora¬ 
tion document-indexer program that se¬ 
lects the most significant terms (phrases) in 
the text. The resulting list of terms con¬ 
tains, on the average, about 130 words per 
article—adatacompressionofabout 3.5:1 
over the original article. Next, these words 
are encoded into a bit-vector data struc¬ 
ture by means of a method called sur- 

word in the content kernel is mapped into 
n different bits in the 1024-bit vector as a 

ticular bit of the bit string, the resuh is 
simply or-ed. For our database, n=10. 


the bits as ones, adding another factor of 
2:1 to the data compression. 

Surrogate coding allows the content 
kernel to be stored more compactly. It also 
speeds up the search process. To test for 
the presence of a given word within a 
document, the same 10 hash functions are 
applied to the word, generating 10 bit 
positions. The 10 bit positions are then 
checked for each of the approximately 
four bit vectors representing each article, 
and if any of them match, the score of the 
overall article is incremented. This scheme 
is probabilistic: it is possible that all 10 bits 
for a word might have been set because of 

really appear in the source document. 



the result of the lookup, 
• First, the probability of a 



Figure 2. Results of seed-document search. Shown at the right are the top eight documents—those most similar to the document 
selected in Figure 1. (Note that since only one document was used to form the search pattern, it appears first because it is perfectly 
similar to itself.) Scores for the documents are shown to the right of the “Good” and “Bad” boxes. Any number of “Good” and 
“Bad” selections can be batched together. Terms in “Bad” documents that do not appear in “Good” ones are given negative 
weights. 
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only one of many terms contributing to the 
score, and so will have only a small effect 
even when it does occur. 

The source document in its original 
form is available for retrieval by and 
presentation to the user when needed. The 
location of the original document on the 
system disk is stored with the content 
kernel. 

Programming the 
document retrieval 
system 

The Connection Machine system’s easy 
programmability is probably its greatest 
advantage over its competition. The fig¬ 
ures referred to in this section illustrate this 
point by showing program code for the 
document retrieval system described 
above. Both * Lisp and C * versions of 
the program are included. Programs for 
several of the other applications in this ar¬ 
ticle can be found in Introduction to Data- 
Level Parallelism. ^ 

The content kernel’s data structure is 
made up of the following fields: 

• * score* is used by the document 
lookup program to accumulate the rank¬ 
ing of each content kernel in the database. 
Rank is awarded according to how closely 
the content kernel matches the user’s 
search pattern. Each time a match is 
found, *score* is updated. 

• *</ocuwent-/<f* contains a reference 
to the original source document from 
which a content kernel was derived. When 
a content kernel is selected, the user is 
shown the source document referred to by 
this field. 

• * kernel* is a table of the surrogate- 
coded bit-vector encoding. 

The necessary declarations for these 
fields are shown in Figure 3. (All of the 
code for this example is presented twice, 
first in the * Lisp language and then in the 
C * language, to make it easy to compare 
the two languages. Because the characters 
“ * ” and “? ” may not appear in C * iden¬ 
tifiers, such * Lisp names as * score* and 
word^ppearsl are rendered in C ♦ simply 
as score and word^appears .) 

The modifier poly declares variables 
present in all processors. There is also a 
modifier mono, which declares variables 
resident in the front-end machine. 

Document lookup on the Connection 
Machine system. During the first stage of 
document lookup, the user lists a set of 


terms to be used to search the database, 
and receives back a list of documents that 
contain all or some of those terms. The 
user then points to a document that is rele¬ 
vant, and from this document an overall 
search profile of content-bearing words is 
assembled. The search profile is simply a 
list of these words, with weights assigned 
to each word. Next, the search profile is 
broadcast to all processors in the Connec¬ 
tion Machine system. For each word in the 
search profile, a set of 10 bit indices (bit- 
locs) is broadcast. All content kernels that 
have these same 10 bits set have the weight 
of that word (word-weight) added into 
their * score* field. 

The code shown in Figure 4 accom¬ 
plishes this. 

The main search program simply calls 
this routine once for each keyword in the 
keyword list. Since word_appears is a 
parallel variable, its handled in the follow¬ 
ing way when it follows an if: each pro¬ 
cessor whose word_appears\a[\it satisfies 
the test is marked as belonging to the cur¬ 
rently selected set of processors by the 
pushing of a stack bit in each processor. 
Operations broadcast by the front-end 
machine are always carried out only by 
processors in the currently selected set. 
When one exits the scope of the condi¬ 
tional, the stack is popped, and the 
previous currently selected set is restored. 


;;; Declarations for the *Lisp version. 

(defconstant table-size 1024) 
(defconstant hash-size 10) 

(‘defvar 'score*) 

(‘defvar *document-id*) 

(a) ('defvar 'kernel') 

/* Declarations for the C'version. */ 

#define TABLE_SIZE 1024 
#define HASH_SIZE 10 

poly unsigned score, dOcument_id; 

(b) poly bit kernel [TABLE_SIZE]; 

Figure 3. Declarations necessary for (he 
*score*, * document-id*, and *kemel* 
fields, (a) The 'Lisp version, (b) The C* 
version. 


Retrieving the highest scoring docu¬ 
ments. The code in Figure 5 is used to 
retrieve the * document-id * for each of 
the highest scoring content kernels in the 
database. The program returns a list of 
* document-id *s for the content kernels 
with the highest scores. The program first 
retrieves the * docUment-id * for the 
highest score, then for the next highest 
score, and so on, until a list of length 


;;; 'Lisp code for testing the presence of a single word. 

('defun increment-score-if-word-appears (bit-iocs word-weight) 

('let ((word-appears? til)) 

(dolist (bit bit-iocs) 

('set word-appears? 

(and!! word-appears? 

(not!! (zeropi! (load-byte!! 'kernel* (!! bit)(!! 1))))))) 
('if word-appears? 

(a) (*set 'score* (-t-!! 'score* (!! word-weight)))))) 


/* C* code for testing the presence of a single word. */ 

poly void increment_score_if_ail_bits_set 

(mono unsigned word_bit_position [HASH_SIZE], mono int weight) { 
mono j; 

poly bit word_appears = 1; 

fora = 0;j < HASH_SIZE; i-I- + ) 

word_appears & = kernel [word_bit_position[ j ]]; 
if {word_appears) 
score + = weight; 


Figure 4. Code for testing a document for the presence of a single word, (a) The 
'Lisp version, (b) The C' version. 
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document-count is retrieved. The already- 
retrieved? flag is set once a processor has 
had its * document-id * retrieved so that 
the * document-id* will not be retrieved 
again. 

Timing and performance. Benchmark 
tests using Reuters newswire articles have 
been run for document search. The tests 
were performed on a 16K-processor Con¬ 
nection Machine. Each document was 
typically represented by approximately 
130 content words. The content words 
were selected by ConText, a Thinking 
Machines Corporation automatic index¬ 
ing system, from the roughly 400 words in 
an average article. A seed-document 
search is based on the union of the sets of 
content words from several articles, and 
typically involves between 200 and 300 
words. Only 40 milliseconds was required 
to search 15,000 articles (representing 
about 40M bytes of free text) against a 


200-term pattern and to assign scores to 
each article: in another 20 milliseconds, 
the system can select the 20 articles that 
most nearly match the set of 200 terms. 
Exactly the same amount of time would be 
required to search four times as many 
documents (64,000 documents, the equiv¬ 
alent of 160M bytes of free text)* on a 
64K-processor Connection Machine. 

The amount of computation that would 
be required to do the benchmark calcula¬ 
tion on a serial machine is staggering: For 
each document, one would have to eom- 
pare each word with the list of 200 terms in 
the search pattern, and for each term that 
matched, a score would have to be added 
to the document’s overall score. On the 
average, on a serial machine, only about 
1.488 bits of a 1024-bit surrogate code vec¬ 
tor would have to be tested in order to find 


•Note that 160M bytes is equivalent to an entire year of 
news from a typical newswire. 


out that a term does not occur in it, assum¬ 
ing that 10 hash functions are used to en¬ 
code each term, and that one-third of the 
bits in the vector are set. 

On a serial machine, one could test for 
the states of the hashed bits corresponding 
to a term one at a time, until one of the 
tested bits was a zero. For any document in 
which the term occurred, one would have 
to make 10 tests. If one third of the bits in 
each 1024-bit vector are set to one, there is 
a two-thirds chance that the first bit tested 
is zero, a two-thirds chance that the second 
bit is zero, and so on. Thus, the total 
number of tests that must be made is 
(1 test <always > -t- ('A X Vs <just one 
more test>) + (l/9x 36 x2<more 
tests>)-t-. . . . + (‘/3*xy3x8<more 
tests>) -I-(!/3® x9<more 
tests>) = 1.488 tests.) 

Thus, assuming that each term searched 
for occurs in 1 percent of the documents, 
then, on the average, for a database con¬ 
sisting of 64,000 documents and for a 
search profile of 200 words, a serial pro¬ 
gram would have to execute the following 
number of instructions: 

64,000 documents X 4 vectors/docu¬ 
ment X 200 search terms x [(.99 x 1.488 
tests/search term/vector < assuming a 
document miss > -i- .01 x 10 tests/ 
search term/vector < assuming a 
document hit >) X 3 instruetions < in¬ 
crement, AND, test, and jump at a 
minimum > X 1.1 < to allow for addi¬ 
tion of partial results, incrementing 
outer loops, and so on> =265.8 
million instructions. 

In order to carry out this operation in 40 
milliseconds, one would need to have a 
serial machine that operates at (l/.04)x 
2.658x10*= >6645 MIPS. 

Even databases that are larger will be 
able to use the same technique—with two 
enhancements. The first enhancement is 
the use of a very high-speed paging disk 
currently under development; the disk will 
allow larger numbers of content kernels to 
be swapped into the system for searching. 
The second enhancement is the use of 
cluster analysis. When the system has 
many documents on the same subject, it 
need not store all their content kernels in¬ 
dividually. It can store one for the whole 
cluster, then retrieve the full set of related 
documents when these are needed. A sin¬ 
gle document may, of course, participate 
in more than one cluster. As the total 
database size grows, the size of the average 
cluster grows with it, making this a par¬ 
ticularly appropriate technique for large- 


;;; *Lisp code for retrieving documents in order, highest score first. 

Cdefun retrieve-best-documents 
(let ((top-documents-list nil)) 

(*let ({already-retrieved? nil)) 

(dotimes (i document-count) 

(’when (not!! already-retrieved?) 

(•when (= !! ‘score* {'max ’score*)) 

(’let ((next-highest-document (’min (self-address!!)))) 

(setq top-documents-list 
(append top-documents-list 

(list (pref ’document-id’ next-highest-document)))) 

(setf (pref already-retrieved? next-highest-document) t)))))) 
top-documents-list)) 

(a) 


/’ C’ code for retrieving documents in order, highest score first. ’/ 

poly void retrieve_best_documents 

(mono document_count, mono unsigned ’document_id—array) { 
poly bit already_retrieved = 0; 
mono i; 

for (i =0; i < document_count; i -b -i-) { 
if {!already_retrieved) { 
if (score = = (>< = score)){ 

processor’next_highest_document = {<>= this); 
document_id_array[i] = next_highest_document->document_id; 
next_highest_document->already_retrieved = 1; 

} 

} 

} 

} 

(b) 


Figure 5. Code for retrieving the •document-id* for each of the highest scoring 
content kerneis in the database, (a) The ‘Lisp version, (b) The C* version. 
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scale databases. The addition of paging 
and clustering will extend the algorithm 
described above to the 10-gigabyte range 
and beyond. 


Memory-based 
reasoning systems 

One of the unrealized goals of artificial 
intelligence is the creation of programs 
that base their ‘ ‘reasoning” on experience. 
AI researchers have assumed that most of 
the relevant experience of human experts 
is “encoded” in the form of rules. While 
there has been some progress toward the 
goal of automatically generating rules of 
inference, ® the construction of intelligent 
programs has for the most part proven to 
be a difficult task, one that depends on the 
ability of highly skilled individuals to 
create sets of rules. 

We believe that memories of specific 
events, and not rules, are the key to 
reasoning from experience. For example, 
a program could diagnose diseases by 
comparing a patient’s symptoms and 
characteristics with those of all the pa¬ 
tients it knew about; if it could “re¬ 
member” similar patients with similar 
symptoms, those patients could be used as 
a basis for reasoning about the current pa¬ 
tient. Memories of particular instances 
have not been used in the past as a basis for 
reasoning because sequential computers 
are too slow to execute some of the 
necessary basic operations, for example, 
finding on nontrivial amounts of data it 
stores the item most similar to an input 
item. (This capability is sometimes called 
associative memory .) It is important that 
memory-based reasoning systems work 
with large amounts of data, so that it will 
in general be possilple to find instances in 
memory that are close to the current in¬ 
stance. With new parallel architectures, 
specifically with the Connection Machine 
system, such operations suddenly become 
sufficiently fast, even with large amounts 
of data, to use as the basis of reasoning. 

The reason that this solution has been 
largely overlooked in the past is that von 
Neumann machines do not support it well. 
There have been systems, such as Samuel’s 
Checkers player, ’ that work from mem¬ 
ory, but they have required (a) an exact 
match between an item in memory and the 
current situation and (b) a nongeneral 
search algorithm (for example, one for 
hashing or indexing) to retrieve items from 
memory. 


In the real world there may be no exact 
matches, so a “best match” is called for. 
Unfortunately, there is no general way of 
searching system memory for the “best 
match” without examining every element 
of memory. On a von Neumann machine, 
this makes the use of large memories im¬ 
practical. On a fine-grained parallel 
machine, such as the Connection Machine 
system, this problem does not arise until 
the size of the database exceeds the size of 
the machine’s memory; this pushes the 
problem back three or four orders of 
magnitude. 

While it is not yet possible to encode ex¬ 
perience in the manner used by humans, it 
is possible to build practical systems that 
use databases as memory. Like the docu¬ 
ment-search system described in the 
previous section, a memory-based reason¬ 
ing system depends on the capability of the 
CM to search globally for the nearest 
match to items in a database. The system 
also needs to be able to compute statistical 
operations (for example, counting and 
sorting) on large numbers of items very 
rapidly. An example of the CM’s power in 
this domain: It is able to sort large 
numbers of items in a period of time pro¬ 
portional to the square of the log of the 
number of data items. To do this, it uses 
methods similar to the APL programming 
language’s “plus-scan,” which is also 
referred to as “parallel prefix,” “sum- 
prefk, ” or ‘ ‘recursive doubling. ’ ’ * Sets of 
up to 64,000 items can be counted or 
added together in about 300 micro¬ 
seconds. By means of related operations, 
64K items can be sorted in about 30 
milliseconds. This ability makes statistical 
computation tractable, even for large 
amounts of data. The resulting CM system 
can bypass the problems of knowledge ac¬ 
quisition and brittleness that have plagued 
expert system researchers. 

The operation of memory-based rea¬ 
soning. The key operation in memory- 
based reasoning is weighted associative 
search for items in memory that are similar 
to a present case that one hopes to under¬ 
stand or act appropriately on. Once some 
matches (or near matches) have been 
found, they can suggest hypotheses. Other 
operations, which are based on statistics, 
test these hypotheses; to do so, they 
separate important features from unim¬ 
portant ones. 

The operation of memory-based rea¬ 
soning systems can be made clearer 
through an example. Suppose that we 
have a large relational database of medical 


patient records, with fields for age, sex, 
symptoms, features of patient history (for 
example, pack-years smoked, previous 
heart attack(s), and so on), diagnosis, test 
results, treatment, and so on. I will refer to 
the entries in these fields as “features.” A 
program can find diagnostic hypotheses 
for a new patient by 

(1) broadcasting each feature of the 
new patient, 

(2) having each processor compute a 
numerical measure of closeness to 
each feature, and then having the 
processor add this number to a total 
similarity score, and 

(3) selecting from the database the pa¬ 
tients whose total scores are closest 
to that of the new patient. 

There are several possible outcomes: 

(1) all n similar patients received the 
same diagnosis, 

(2) no patients are very similar to the 
new patient, 

(3) only a small number are similar, 
and 

(4) (the general case) there are several 
diagnoses among the nearest n pa¬ 
tients. 

In all four cases, we next run a hypoth¬ 
esis-testing phase. If its results suggest that 
only one diagnosis is plausible, we are 
done; if more than one diagnosis remains, 
a second hypothesis-testing method is in¬ 
voked, which either completes the diag¬ 
nosis, or proposes tests that would differ¬ 
entiate among the remaining possibilities. 
(These processing phases are described in 
more detail below.) However, even at this 
point, we can make some observations: 

• If (1) is true (that is, if all n patients 
have the same diagnosis), it is very likely 
that this patient should also get the same 
diagnosis, and it is likely that we could 
even extract a rule for diagnosing this 
disease that could be added to a micro¬ 
computer-based expert system. 

• If case (2) holds, the system knows 
that it may not have ever seen this set of 
symptoms before, and thus, it “knows 
that it doesn ’t know ” how to diagnose this 
case. (Alternatively, the data on the new 
patient may be in error, and the system can 
also propose this possibility.) 

• In case (3), even if only one patient is 
similar (for example, as in the second 
reported case of Legionnaire’s disease), 
the system may be able to make a reason¬ 
able hypothetical diagnosis. Approaches 
taken in the event of case (4) are described 
below. 
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Table 1. Four cases from the Quack database. 

Field 

1 

2 

3 

4 

Eye-Color 

Brown 

Gray 

Brown 

Brown 

Hair-Color 

Blond 

Brown 

Black 

Brown 

Sex 

Male 

Female 

Female 

Male 

Aches 

- 


- 


Backache 

- 

- 

- 

- i 

Chills 


- 

- 

1 

Nausea 

- 

- 

- 

j 

Period-Late 

N/A 

1 

2 

N/A : 

Running-Nose 

- 

- 

- 

I 1 

Sneezing 

4- 

- 

- 


Sore-Throat 

+ 

- 

- 

! 

Tired 

+ 

- 


_r— - _ J 

Fever 

Mild 

None 

None 

None "i 

P-Test 

_ 

- 

+ 

! 

T-Culture 


- 

- 

1 

U-Test _ 


- 

_ 


Condition 

Throat 

Healthy 

- 


■ . __ .... 


A system for medical reasoning. The 
idea of memory-based reasoning has been 
successfully demonstrated in a preliminary 
test of feasibility.® A medical reasoning 
system called Quack was constructed. 
Since the creators lacked quick access to a 
real database of medical cases, one was 
created: a stochastic model that draws on 
the creators’ commonsense knowledge of 
common medical conditions (hence the 
name!). This example is not offered as 
compelling evidence of the correctness of 
our theories, only as an illustration and as a 
limited demonstration of their feasibility. 

Quack simulates the process of diagnos¬ 
ing a patient. It starts with a database of 
past cases, including symptoms, personal 
data, results of tests, and the ultimate 
diagnosis. It is then given information 
about a series of patients, starting with 
personal data and symptoms. First, it 
forms and evaluates a set of hypotheses, 
eventually narrowing them down to a set 
of between one and three possibilities. It 
then selects some tests (for example, tak¬ 
ing the patient’s temperature), and uses 
the test results to make a final determina¬ 
tion. Quack does all this without being 
given any rules or other information; it has 
only the database of past cases. 

The database is created by a multiphase 
stochastic process. First, personal at¬ 
tributes (such as sex, hair, and eye color) 
are chosen at random. Sex is a significant 
feature, while hair and eye color are added 
in an effort to distract the system. Second, 


a medical condition is generated. The pos¬ 
sible conditions include pregnancy, in¬ 
fluenza, colds, over-exertion, good 
health, and a variety of other conditions. 
Third, directly observable symptoms are 
generated. These symptoms incude gener¬ 
alized aches and pains, backaches, chills, 
nausea, and sneezing. The symptoms of 
various conditions overlap, symptoms are 
absent in some cases, and symptoms unre¬ 
lated to the primary condition sometimes, 
appear (for example, tiredness and aches). 
Finally, the results of several tests that a 
physician might order are predicted, in¬ 
cluding the results of taking a patient’s 
temperature and taking a throat culture 
for strep throat. Table 1 shows four cases 
from this synthetic database. 

The basis of Quack is the retrieval from 
a database of cases similar to that of the 
current patient. The most important as¬ 
pect of this retrieval problem is the metric 
used in computing similarity. This metric 
must give low weight to irrelevant 
features, such as hair and eye color; high 
weight to definitive features, such as the 
results of pregnancy tests; and inter¬ 
mediate weight to suggestive features, 
such as aches and chills. Brief reflection in¬ 
dicates that no one metric is adequate. For 
example, if a patient is suspected of having 
the flu, his or her sex is completely irrele¬ 
vant and should be given zero weight. On 
the other hand, in diagnosing pregnancy, 
sex is definitive, and should be given ex¬ 
tremely high weight. Thus, the metric is 


dependent on the system’s hypothesis. 

The metric is calculated “on the fly.” 
Given a hypothesis, the system will deter¬ 
mine how well each feature correlates with 
the hypothesis, and choose weights aceord- 
ingly. For example, if Quack hypothesizes 
that a patient has the flu, it will compute 
the proportion of males having the flu, the 
proportion of females having the flu, and 
note that sex is not a significant predictor 
for influenza. Thus, it will assign a low 
weight to sex. On the other hand, if Quack 
hypothesizes that a patient is pregnant, it 
will note that men are never pregnant, that 
females are sometimes pregnant, and give 
sex a weight sufficiently high to exclude 
men from consideration. 

The next step is to find the cluster of 
cases most similar to that of the current 
patient. This is done by applying the 
metric to every case in the database, then 
extracting the cases most similar to that of 
the patient. Once the cluster of similar 
cases has been retrieved, the proportion of 
cases matching the hypothesized diagnosis 
is calculated. This may strengthen or 
weaken the hypotheses. In addition, the 
composition of the cluster will be used to 
generate additional hypotheses, which will 
be evaluated in turn. 

This process of hypothesis generation 
and evaluation is illustrated by the follow¬ 
ing sample run. The test patient was male 
and was experiencing a sore throat, chills, 
and tiredness. Quack started with the as¬ 
sumption that he was healthy. This hy¬ 
pothesis generally yields a good initial 
metric and, while the hypothesis of good 
health is usually rejected, comparison with 
those cases in which patients are unhealthy 
in a similar manner yields good hypoth¬ 
eses. In this case, several hypotheses did 
emerge, including the flu, nonspecific 
throat infection, and strep throat. Each of 
these hypotheses was tested in turn. The 
only ones that survived this stage of the 
evaluation were nonspecific throat infec¬ 
tion and strep throat. Table 2 shows the 
output of this phase of the trial. It may be 
noted that implausible hypotheses are 
generated. This is not directly harmful 
because the hypothsis-evaluation step is 
sufficiently strong to weed out the bad 
hypotheses. 

Once the initial diagnosis is made, 
several alternatives may remain, in which 
case a second phase of reasoning is neces¬ 
sary. First, the resolving power (definitive¬ 
ness) of various tests is computed, relative 
to the possibilities generated in the first 
phase. Second, those tests that have high 
resolving power are selcted for use in a sec- 


92 


COMPUTER 








ond phase of hypothesize-and-test. In the 
example we have been looking at, two tests 
were selected: taking a throat culture and 
taking the patient’s temperature. When 
these added factors were taken into ac¬ 
count, a solid diagnosis was made. A trace 
of this phase is shown in Table 3. 

This example required 8.9 seconds to 
run on a database of4096 examples. It was 
also run on a database of 32,768 examples, 
where it took 10.7 seconds to run and gen¬ 
erated fewer false hypotheses. It was also 
run on a database of 512 examples, where 
it took 4.3 seconds to run but misdiag¬ 
nosed the case (the small database con¬ 
tained only one case of strep). In general, 
increasing the size of the database im¬ 
proves the quality of the system’s reason¬ 
ing without significantly changing the time 
needed for generating hypotheses. For 
very small databases, the system’s perfor¬ 
mance deteriorates somewhat, but the sys¬ 
tem remains capable of handling the more 
common problems. Recent research has 
added learning to the system, allowing it to 
perform much more accurately and rapid¬ 
ly. The new system precomputes weight¬ 
ings, and can generate hypotheses with a 
single lookup operation. 

It is possible to criticize Quack on the 
ground that all its deductions are extreme¬ 
ly obvious. But that is precisely the point: 
The basis of intelligent behavior must in¬ 
clude a grasp of the obvious, something 
that is sorely lacking in rule-based systems. 
Remember, Quack does not have a knowl¬ 
edge base, only a collection of weak meth¬ 
ods for making decisions based on memo¬ 
ry. It also has the useful property that, as 
its base of experience grows, it gets smarter 
rather than stupider: The quality of its de¬ 
cisions improves without incurring a sig¬ 
nificant time penalty. 

Memory-based reasoning was also tested 
more recently—on a word-pronunciation 
task very similar to NETtalk’s.Its per¬ 
formance was somewhat superior to NET- 
talk: The memory-based reasoning system 
we built, called MBRtalk, was able to gen¬ 
erate understandable pronunciations for 
about 65 percent of the novel words it was 
given; the basis of its reasoning was the 
known pronunciations of about 4500 ran¬ 
domly selected English words. This re¬ 
search is described by Stanfill and Waltz. ® 

Evaluation of memory-based reasoning. 
Computer learning has generally stayed 
within the heuristic search/deductive 
reasoning paradigm: Most algorithms for 
learning try to derive a set of rules from a 
body of data. This aproach is exemplified 


by the work described by Michalski, Car- 
bonell, and Mitchell.'' Memory-based 
reasoning, in its pure form, differs from 
traditional learning methods in that no 
rules are ever created (although, as men¬ 
tioned above, it can be used to generate 
rules, in a manner similar to Quinlan’s 
ID3.*) Reasoning from examples, rather 
than from rules, has several advantages. 
First, the deductions made by the system 
are achieved without the intermediate use 
of rules as a representation, so there are 
fewer opportunities for inadvertently in¬ 
troducing inaccuracies, for example, those 
that result from combining “confidence 
levels” for a chain of rules. Second, rule 
generation has a combinatorially explosive 
search space of possible rules to contend 
with, while memory-based systems can 
focus their analysis on the case at hand. It 
may be that in capturing a large knowledge 
base, so many rules are needed that the 
rule-generation process will never finish. 
If this is the case, there is never any certain¬ 
ty that the resulting rule set is complete, 
and the resulting system may fail at any 
moment. With a memory-based system, 
the data used as the basis of reasoning is 
always available. Therefore, within limits 
imposed by the accuracy of the retrieval 
mechanism and the contents of the data¬ 
base, errors of omission should not occur. 

Space does not allow an extended dis¬ 
cussion of this work in rule-based reason¬ 
ing. It is closely related to other research- 
in parallel associative memory, semantic 
nets, and “case-based reasoning.” 

Memory-based reasoning systems may 
be able to function like expert systems in 
domains where there are databases of situ¬ 
ations and outcomes/actions. Possible ap¬ 
plication areas include medical diagnosis 
and proposal of diagnostic tests, weather 
forecasting, deciding whether to extend 
credit to a customer, investment advising, 
insurance-risk assessment, and many 
others. No expert is required; a knowledge 
engineer only needs to identify database 
contents and to mark them according to 
whether they are symptoms or features of 
situations; outcomes or actions; or op¬ 
tional tests that can be ordered. Memory- 
based systems can form hypotheses on the 
basis of even a single precedent, something 
rule-based systems cannot do—rules are 
inherently summaries of regularities 
among classes of items. And memory- 
based reasoning systems ‘ ‘know when they 
don’t know”: If no items in memory are 
closely related to the item being analyzed, 
then the system is able to recognize this 
fact and to tell the user. 


Table 2. Initial diagnosis of a patient 
as performed by Quack. 

Likelihood 

Healthy 0.0 

Suggests 

Throat, Strep, Flu 

Likelihood 

Flu 0.0 

Suggests 

Pregnant, Ov-exer, 

Cold, Ut-inf* 

Likelihood 

Ut-inf* 0.0 

Likelihood 

Cold 0.0 

Likelihood 

Ov-exer 0.0 

Likelihood 

Pregnant 0.0 

Likelihood 

Strep 8.031373 

Likelihood 

Throat 33.573772 

Resultant likelihood of hypotheses: 

Throat 

0.8070 

Strep 

0.1930 

*“Ut-inf” stands for urinary tract 
; infection. 


Table 3. Quack’s diagnosis of a patient 
after the taking of a throat culture. 

Tests Fever, T-culture 

Likelihood Throat 0.0 

Likelihood Strep 3.766667 

Resultant likelihood of hypothesis: 
Strep 1.0000 


Bulk processing of 
natural language 

A natural-language processing system 
that finds indexable phrases in natural 
language text has been implemented on 
the Connection Machine. (This system 
was mentioned earlier as a component of 
the document-retrieval system.) The 
system operates in two phases, as il¬ 
lustrated in Figure 6. In the first phase, the 
definition for each word is looked up. For 
the purposes of this task, the definitions 
consist of part of speech information for 
many words; for other words, the defini¬ 
tion simply states that the word should be 
deleted because it cannot be part of an in¬ 
dex. For example, most adverbs and 
words such as “if,” “among,” and “be¬ 
tween” can never be part of an index term. 
Word definitions also mark whether the 
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word is the name of a famous person, a 
day of the week, the name of a month, and 
so on. In the second phase, a series of 
ATN (Augmented Transition Network) 
parsers is run over all the text simulta¬ 
neously; during this phase, all noun 
phrases are found simultaneously. 

Let us suppose that we have a simple 
ATN grammarthat specifies that a 
noun phrase consists of a determiner 
followed by any number of adjectives 
followed by a noun. Let us assume that 
each word has been assigned to a virtual 
processor, and that parts of speech have 
been stored for each word. This grammar 
is used to parse all of the noun phrases that 
match it, in the following manner; First, 
an instruction is broadcast to all pro¬ 
cessors; it says that if the processor con¬ 
tains a determiner, then the address of the 
processor (the starting address for the 
noun phrase) and a special state symbol, 
“Ql,” should be sent to the processor to 
the right of the given processor. (The pro¬ 
cessor to the right of the given one holds 
the next word of the text.) 

In the next phase, all processors that 
contain symbol Ql are selected and in¬ 
structed to check the defmition(s) of their 
word. If the word can be an adjective, then 
the symbol Ql and the phrase-starting ad¬ 
dress are passed to the next processor. The 
system then checks to see whether any cell 
used this rule during the last cycle. If the 
rule was used, then the rule is repeated 
until no processors use it. The net result is 
that when the longest string of adjectives 
preceding a noun has been parsed, the 
rule is used no longer and the next rule is 
broadcast. In this rule, any processor that 
contains state symbol Ql and also con¬ 
tains a noun can then return a noun 
phrase that runs from the initial deter¬ 
miner to the noun itself, and thus the 
parsing of all such noun phrases in the 
system is completed. 

In general, the grammar is nondeter- 
ministic; that is, there is more than one 
pattern for noun phrases. All such pat¬ 
terns are broadcast, one after another, and 
in the end, all the noun phrases are 
marked. Occasionally, one noun phrase 
may appear to overlap another; in that 
case, both can be returned or a serial com¬ 
puter can attempt to judge which inter¬ 
pretation should have priority. A typical 
simple scheme that does not require serial 
arbitration is to use the longest noun 
phrase if two overlap. 

We have used several algorithms for 
assigning parts of speech to a word. The 
one currently in use depends on the scan 


and sort operations described briefly in the 
section on “Memory-based reasoning sys¬ 
tems” (above) and illustrated in Figure 7. 
Both (a) the dictionary definitions and (b) 
the words of text to be processed are 
stored, one each per virtual processor. 
Next, all the words, from both the dic¬ 
tionary and the text, are sorted. The dic¬ 
tionary items are, in effect, subscripted 
with a zero, and the words in the text are, 
in effect, subscripted with a one, so that at 
the end of the sort phase, the words appear 
with a dictionary entry followed by all the 
occurrences of that word in text, which are 
in turn followed by the next word in the 
dictionary and all its occurrences in the 
text. A variation of the scan operation can 
then be used to spread, in a time propor¬ 
tional to the log of the most frequently oc¬ 
curring words in the text, the definition to 
all words that follow a dictionary word. 
This method allows this system to assign 
parts of speech to 64,000 words in about 
70 milliseconds. 

Another scheme, currently being pro¬ 
grammed, operates by the following 
method: Each dictionary word is hash 
coded and sent to a particular processor. 
To find parts of speech for words in a text, 
the hash code for each word of the text is 
computed, and a message is sent to the 
computed hash code address. Definitions 
are then sent back to all the words that re¬ 
quested them. The total time for this 
algorithm should be less than 10 
milliseconds. 


Other applications 

Several other applications have been im- 
piemented on the CM that have application 
to AI research in qualitative reasoning. 

• A SPICE-like VLSI-circuit-simula- 
tion system has been devised that has run a 
circuit of 8000 transistors. Such a system 
could be used as a basis for a system that 
could reason about the behavior or diag¬ 
nosis of such circuits. 

• A VLSI-layout program that uses 
simulated annealing has been devised. We 
are currently investigating the use of in¬ 
telligent energy-weighting schemes that 
would use a database of layout decisions 
previously made by a designer; the inten¬ 
tion is that the schemes assign priorities to 
proposed exchanges of cells. 

• A system to model fluid dynamics has 
been built on the basis of a cellular 
automated model.The “fluid flow” 
operates by means of a 16-million-cell grid 
with four million particles moving across 


it. The particles Interact at each cell, and 
their gross behavior simulates fluid flow 
(including vortex shedding and aperiodic 
flow) without the use of Navier-Stokes 
equations. Such a system could also be 
used to make judgments about the general 
qualitative behavior of fluids, liquids, and 
articulated or flexible solids. 

• Experiments have been undertaken 
for a variety of connectionist and other 
learning models (for example, Rosenberg 
and Sejnowski’s machine).(See also the 
article by S. Fahlman and G. Hinton in 
this issue of Computer.) The Connection 
Machine is extraordinarily well-suited to 
such tasks, and early results suggest a 
speedup in excess of two orders of mag¬ 
nitude over the minicomputers and work¬ 
stations on which such systems are typical¬ 
ly run now. 

• The Connection Machine system is 
able to analyze a pair of images of terrain, 
taken from two different vantage points, 
to determine the terrain elevation and to 
draw a contour map. A production-level 
version of the contour-mapping algorithm 
has been implemented and extensively 
tested. A typical program run processes 
images containing 512 x 512 (262,144) pix¬ 
els. In such a mode, the Connection 
Machine system performs approximately 
two billion (2x10®) operations during the 
inner loop of the algorithm. In the inner 
loop, the matchups are detected and their 
alignment quality is measured. This inner 
loop is executed in less than two seconds 
on a 16K CM, or in half a second on a 64K 
CM. 


T he Connection Machine system 
has already proved itself to be both 
easily programmable and applica¬ 
ble to a wide variety of applications. Most 
CM applications to date have used the 
method of data-level parallelism, in which 
each datum is assigned to a processor. 
Many of the applications depend on the 
methods of “recursive doubling,” which 
allow associative operations (counting, 
addition, matrix multiplication, and so 
on) to be applied to large amounts of data 
in log time. * Unlike most current com¬ 
mercial products, the Connection Ma¬ 
chine scales to much larger problems by 
simply adding more processors, or by 
hooking machines together. We believe 
that we have only begun to explore this ex¬ 
citing new technology, and we look for¬ 
ward eagerly to the applications prospects 
of the next few years. □ 
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Format of Processor Diagram: 


Rtrinq - Processor # 


Defined? 

Definition Bits: BE 
Original-Address: 

Black if Selected: 


the-1 

boy-2 

ale-3 

D?: 0 

D?: 0 

D?: 0 

B: 

B: 

B: 

N: 1 

N: 2 

N: 3 

1 

1 

■ 


D?: 1 

B: too 


D?: 1 

: 010 


D?: 1 

B: Oil 


the-9 

D?: 1 


I 

Dictionary 


ate-1 

ale-2 

boy-3 


boy-4 

D?: 1 

D?: 0 

D?: 1 


D?: 0 

B: 100 

B: - 

B: 010 


B: 

N: 

N: 3 

N: 


N: 2 

1 

1 

■ 


I 


pizza-6 


ate-1 


ale-2 

boy-3 

D?: 1 


D?: 1 

D?: 1 

B: 100 


B: 100 

B: 010 

N: 


N: 3 

N: 

■ 


1 

■ 


bov-4 


pizza-6 


D?: 1 

B: 001 


D?: 1 

B: Oil 


Definition 
not used 


Definition 
not in dictionary 


lhe-1 

boy-2 

ale-3 

D?: 1 

D?: 1 

D?: 1 

B: 001 

B: 001 

B: 100 

N: 1 

N: 2 

N: 4 

1 

1 

I 


bov-7 


D?: 1 

B: 010 


D?: 1 

B: 001 


Text 


(e) 


- 1 - 

Dictionary 


Figure 7. Illustration of CM sort-scan algorithm for assigning parts of speech to a word, (a) Format of processor diagram, (b) 
Both the dictionary words and the text words are stored in the CM. (c) An alphabetic sort is performed. (The dictionary is merged 
into the text.) (d) Definitions are spread to all words, (e) Definitions and text are sent back to original addresses. (Source: 1986 
ACL Conference Proceedings, “Bulk Processing of Text on a Massively Parallel Computer.” Used by the courtesy of the 
Association for Computational Linguistics.) 
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Connectionist 
Architectures for 
Artificial Intelligence 


Scott E. Fahlman and Geoffrey E. Hinton 
Camegie-Mellon University 


Massively parallel 
netivorks of simple 
neuron-like processing 
elements may hold the 
key to some important 
aspects of intelligence 
not captured hy 
existing AI technology 
on serial machines. 


C urrent AI technology can do a 
good job of emulating many of 
man’s higher mental functions, 
but some of the most fundamental aspects 
of human intelligence have proven more 
elusive. AI can match the best human ex¬ 
perts on certain narrow technical prob¬ 
lems, but it cannot begin to approach the 
common sense and sensory abilities of a 
five-year-old child. Some important ingre¬ 
dients of intelligence seem to be missing, 
and our technology of symbolic represen¬ 
tation and heuristic search, based on serial 
computers, does not seem to be closing the 
gap. Among the missing elements are the 
following: 

• The human memory can store a huge 
quantity and variety of knowledge, and 
can find relevant items in this storehouse 
very quickly and without apparent effort. 
The phenomenon we call common sense is 
complex, but it deri ves in part from t he 
rea dy availability ..o t a larg e,, body of 
as sorteJ^knowledge about th e world. Our 
serial machines can store large amounts of 
information, but it is very hard to make 
this knowledge an effective part of the 
machine’s activities. 

• In many domains, human recognition 
abilities far exceed what our machines can 
accomplish. Whether the domain is speech 
recognition, vision, or some higher-level 
task like medical diagnosis, the key opera¬ 
tion seems to be an ability to locate, from 
among all known candidates, the one that 
best matches the sample to be identified. 
We humans can do this even with noisy, 
distorted input data and faulty expecta¬ 
tions. For us, this is quick and seemingly 
effortless. 


• In many cases, humans seem to han¬ 
dle information in some form other than 
the symbolic assertions of traditional AI. 
We can all recognize an elephant, but few 
of us can describe its appearance sym¬ 
bolically in an unambiguous way. We have 
difficulty coming up with formal symbolic 
descriptions for movements, shapes, 
sounds, and spatial relationships, and yet 
people work easily in all these domains. It 
can be argued that we humans use internal 
symbolic representations that we cannot 
access consciously, but it seems more 
plausible that some other kinds of 
representations are in use. 


The traditional AI approach to knowl¬ 
edge and recognition problems is to use 
ever more complex and clever strategies to 
reduce the need for excessive search and 
computation. An alternative is to solve 
such problems with a less complicated but 
very cycle-intensive approach, using very 
large numbers (millions) of very simple 
processors to get the job done in a reason¬ 
able time. For example, one approach to 
interpreting visual input is to use clever 
reasoning to restrict the areas in which a 
computationally expensive edge-finder is 
applied. The alternative is to simply accept 
the cost of doing high-quality edge finding 
all over the image—even in places that will 
turn out not to be critical to later stages of 
interpretation. 

A number of researchers have begun ex¬ 
ploring the use of massively parallel ar¬ 
chitectures in an attempt to get around the 
limitations of conventional symbol pro- 
I cessing. Many of t hese parallel archit ec- 
I tures are^jm ecaqgst: The system’s col- 
r lection of permanent knowledge is stored 
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as a pattern of connections or connection 
strengths among the processing elements, 
so the knowledge directly determines how 
the processing elements interact rather 
than sitting passively in a memory, waiting 
to be looked at by the CPU. Some connec- 
tionist schemes use formal, symbolic 
representations, while others use more 
analog approaches. Some even develop 
their own internal representations after 
seeing examples of the patterns they are to 
recognize or the relationships they are to 
store. 

Connectionism is somewhat controver¬ 
sial in the AI community. It is new, still un¬ 
proven in large-scale practical applica¬ 
tions, and very different in style from the 
traditional Al approach. We have only 
begun to explore the behavior and poten¬ 
tial of connectionist networks. In this arti¬ 
cle, we describe some of the central issues 
and ideas of connectionism, and also some 
of the unsolved problems facing this ap¬ 
proach . Part of the motivation for connec¬ 
tionist research is the possible similarity in 
function between connectionist networks 
and the neural networks of the human cor¬ 
tex, but we concentrate here on connec- 
tionism’s potential as a practical technolo¬ 
gy for building intelligent systems. 


What is connectionism? 


Jerry Feldman coined the term “co n- 
nectioni^ '” to refer to the study of a cer- 
tai n class of massively parallel architectur es 
for artificial intelligence . A connectionist 
system uses a large number of simple pro¬ 
cessing elements or units, each connected 
to some number of other units in the sys¬ 
tem. The units have little information 
stored internally, typically only a few 
marker bits or a single scalar activity-level, 
used as a sort of short-term working 
memory. The long-term storage of infor¬ 
mation is accomplished by altering the 
pattern of interconnections among the 
units, or by modifying a quantity called 
the weight associated with each connec- 
1 tion. This use of connections, rather than 
memory cells, as the principal means of 
jstoring iWSrmation motivated the name 
I connectionism. 

The parallel processing units in a con¬ 
nectionist network do not follow individu- 
l al programs. The units are capable of only 
\ a few simple actions such as accepting in- 
Jcoming signals, performing some Boolean 
or arithmetic processing on the data, and 
Isending signals out over some or all of the 


connections. These operations may be 
completely autonomous—part of a unit’s 
built-in behavior—or they may be con¬ 
trolled by commands broadcast by some 
external controller, perhaps a serial com¬ 
puter of the traditional kind. 

Since all of the connections can carry 
signals simultaneously, and all of the pro¬ 
cessing elements can act in parallel to in¬ 
tegrate their arriving data, a connectionist 
system can bring a large amount of knowl¬ 
edge to bear simultaneously when making 
a decision, and can weigh many choices at 
once. 

In some connectionist systems, the par¬ 
allelism is used to implement a sort of si¬ 
multaneous brute-force search through 
units, each representing a single item in the 
knowledge base. In other systems, the par¬ 
allelism is used to allow richer representa¬ 
tions; the pattern of activity in a large 
group of units represents an item, and dif¬ 
ferent items are represented by alternative 
patterns of activity. Given some inputs and 
an initial state of the network, one of these 
patterns will emerge. Many connections, 
representing many small pieces of knowl¬ 
edge, will play a role simultaneously in 
determining which alternative will win. 
Whichever strategy is used, this ability to 
bring a lot of knowledge into the game at 
once is a major reason for the growing in¬ 
terest in connectionism. 

,The interunit signals sent through the 

connec tions are typicatly single-bit n iiark- 

ers or continuous scalar valu es. Thus, we 
speak of marker-passing or value-passing 
parallelism. A unit can receive many of 
these signals at once, each arriving over a 
different connection. These multiple sig¬ 
nals are combined upon receipt: Multiple 
instances of the same marker bit are simply 
OR’ed into one, and multiple scalar values 
are usually just combined into a weighted 
sum as they arrive at the destination unit. 
Systems that send more complex symbolic 
messages from unit to unit, the so-called 
message-passing parallel systems, are not 
usually considered connectionist systems 
because they require much more complex 
processing units with a considerable 
amount of storage for the messages. 

An important difference between the 
connectionist approach and the more con¬ 
ventional “modestly parallel” architec¬ 
tures for AI is that the connectionists are 
willing to assign a processing element to 
each tiny subtask (one element for every 
item of knowledge in the system, for ex¬ 
ample) and to postulate that there are 
enough of these simple processing ele¬ 
ments to handle the task at hand. The 


more conventional approach assumes a 
fixed number of larger processors (typical¬ 
ly between 2 and 1024) and tries to find 
ways of cutting the problem up into that 
many pieces, all of which can be worked 
on concurrently. 

In a serial system, the time required to 
sift through a finite set of items in memory 
or to consider a finite set of hypotheses in a 
recognition task grows linearly with the 
size of the set. The modestly parallel ap¬ 
proach attempts to approach Af-fold 
speedup from processors. The connec¬ 
tionist thinks in terms of performing these 
simple tasks in constant time, while the 
amount of hardware grows linearly with 
the number of memory items or the num¬ 
ber of hypotheses to be considered at 
once. This view may seem less radical if we 
think of a connectionist unit not as a CPU 
but as a fancy kind of memory cell that 
stores knowledge in its connectivity or 
connection weights. We need enough of 
these memory cells to hold the system’s 
knowledge. 

Many kinds of connectionist architec¬ 
tures are being investigated by the small 
but growing community of researchers in¬ 
terested in this kind of parallelism. It is 
hard to say much more about these sys¬ 
tems as a class, and in an article of this 
length it is impossible to mention all of the 
connectionist research going on. We will 
describe some of the key issues and ideas 
that seem important to us, and mention 
one or two pieces of work exemplifying 
each of these key ideas. 


Distributed 

representations 

The simplest way to represent things in a 
massively parallel network is to use local 
representations, in which each concept or 
feature is represented by a specific piece of 
hardware. For example, when the system 
wants to work with the concept of “ele¬ 
phant,” it turns on the elephant unit. This 
kind of representation is easy to create and 
easy to understand. Unfortunately, if the 
elephant unit breaks, the system loses all 
of the knowledge tied to it. This creates 
some obvious reliability problems: In a 
system with millions of processing ele¬ 
ments, not all of them will be working all 
the time. It also means that most of the 
units will be idle most of the time. 

Many neuroscientists believe that the 
brain does not work this way, that instead 
it uses some sort of distributed representa- 
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Figure 1. A portion of a NETL semantic network. This fragment describes Clyde 
the elephant and related information. (Source: Artificial Intelligence, Vol. 1, 1985. 
Used by the courtesy of MIT Press, publisher.) 



Figure 2. NETL hardware corresponding to “Clyde is an Elephant.” (Source: 
Artificial Intelligence, Vol. 1, 1985. Used by the courtesy of MIT Press, 
publisher.) 


tion-. A concept like “elephant” is repre-, 
sented not by a single neuron, but by a pat¬ 
tern of activation over a large number of 
neurons. They often use the analogy of a 
hologram, in which each point of the im- 
"age is constructed from information from 
all over the film: if some part of the h olo- 
sram is destroyed, the total image is de¬ 
graded slightly, but no part of the im age is 
completely lost ! A distributed represen- 

tation in a massively parallel network 
(whether built from neurons or silicon) 
would have a similar kind of reliability: If 
a few of the units malfunction, the result¬ 
ing pattern is imperfect but still usable. 
Each macroscopically important behavior 
of the network is implemented by many 
different microscopic units, so any small 
random subset can disappear without 
changing the macroscopic description of 
the network’s behavior. 

This kind of inherent fault-tolerance 
has important implications for the con¬ 
struction of large-scale parallel networks. 
For example, \ac ^fer-s cal e integration be¬ 
comes more feasibleTslnce aTew inalfunc- 
tioning units in the wafer would simply be 
ignored. It is almost certainly easier to 
build a billion-transistor system, in which 
only 95 percent of the circuit elements 
have to work, than to build a million-tran¬ 
sistor system that has to be perfect. It can 
also be shown' that in many situations it is 
much more efficient, in terms of the num¬ 
ber of units required, to represent a value 
using a coarse-coded distributed scheme 
than to assign a single unit to represent 
each sm2ill interval in the range. In the 
coarse-coded scheme, each unit is coarsely 
tuned to cover a considerable range of 
values, and a particular value is repre¬ 
sented by activity in a number of overlap¬ 
ping units. 

The main disadvantage of distributed 
representations is that they are hard for an 
outside observer to understand or to 
modify. To add a single new piece of 
macroscopic knowledge to a network that 
uses distributed representations, it is 
necessary to change the interactions be¬ 
tween many microscopic units slightly so 
that their joint effects implement the new 
knowledge. For any problem of signifi¬ 
cant size, it is nearly impossible to do this 
by hand, so it follows that a network using 
a distributed representation must employ 
some sort of automatic learning scheme. 
In the absence of an automatic learning 
procedure that works efficiently in large 
networks, distributed representations are 
generally too awkward to be of much 
practical value. 
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NETL: A connectionist 
system for S3anbolic 
knowledge 

The NETL systg m^ is an example of a 
connectionist architecture that uses local 
representations. It was designed to store 
and access a large number of symbolic 
assertions, and to perform certain simple 
searches and deductions within this collec¬ 
tion of knowledge. NETL ij an implemen- 
tati on in hardware of a semantic net work, 
a graph-like data structure in whTch the 
nodes represent noun-like concepts and 
the links represent relationships between 
these concepts. Such a network is illus¬ 
trated in Figure 1; the NETL hardware 
corresponding to a part of this network is 
illustrated in Figure 2. 

In the NETL system, each of the nodes 
in the network is represented by a simple 
processing unit, capable of storing a few 
single-bit markers and of performing sim¬ 
ple Boolean operations on the markers. 
Each link is also a simple processing unit, 
wired up to two or more node units. Link 
units, too, can perform simple Boolean 
operations, which generally amount to 
passing a specific marker from one of the 
attached nodes to another. All of the 
nodes and links in the network can per¬ 
form these operations simultaneously in 
response to commands broadcast by the 
system controller, a serial machine of the 
familiar sort. 

Every time a new assertion is added to 
the system, new nodes and links must be 
wired into the network to represent that 
assertion. Since all the node-to-link con- 
neetions must be capable of carrying sig¬ 
nals simultaneously, they must be true 
private-line connections and not just ad¬ 
dresses sent over a shared party-line bus. 
Of course, in a practical implementation, 
these new connections would be estab¬ 
lished in a switehing system resembling a 
telephone exchange and not by stringing 
tiny wires from unit to unit. 

A NETL network can perform searches 
and simple inferences that go beyond what 
can be done with a simple associative 
memory. For example, a very heavily used 
operation in most AI knowledge-based 
systems is inheritance: We want anything 
we know about the typical elephant to ap¬ 
ply to the subclasses and individuals below 
elephant in the hierarchy of is-a links 
(unless that inherited information is spe¬ 
cifically canceled for some individual). Be¬ 
cause of branching in the is-a hierarchy, an 
individual node like Clyde might inherit in¬ 


formation from a large number of superi¬ 
or nodes, so we need some very fast way of 
scanning a large part of the network. 

In NETL, inheritance is handled by 
marker propagation. If the problem is to 
find the color of Clyde the elephant, the 
controller sets marker 1 on the Clyde node, 
then repeatedly orders any is-a link with 
marker 1 set on the node below it to pass it 
on to the node above. When the network 
settles, we have marker 1 on all of the 
nodes representing superior classes from 
which Clyde is supposed to inherit proper¬ 
ties. We then command every color-of link 
with marker 1 on its tail to put marker 2 on 
its nose. Finally, we ask every node 
marked with marker 2 to report its identity 
to the eontroller. In this case, we get a 
single winner, the gray node. In a few 
cycles, we have followed a chain of in¬ 
ference to locate this information, regard¬ 
less of where in the network the color in¬ 
formation may have been attached. (The 
actual sequence of operations is slightly 
more complex than this, due to the possi¬ 
ble presence of exeeptions in the network, 
but the idea is the same.) 

Because of its ability to do set intersec¬ 
tions in parallel, NETL can handle recog¬ 
nition tasks of a certain limited kind. 
Suppose we are eonfronted with a gray 
four-legged mammal and we want to 
quickly locate any stored description that 
exhibits the intersection of these features. 
By marker-propagation from the feature 
nodes, we can mark all of the gray things 
with one marker, four-legged things with a 
second marker, and mammals with a third. 
Then we simply broadcast a command 
that any unit with all of these markers 
should queue up to report its identity to 
the controller. The interseetion step takes 
only a small, constant time, regardless of 
the size of the sets being intersected. 

This approach to recognition is very 
strong in some ways, but weak in others. 
On the positive side, NETL examines all of 
the descriptions in memory at once, not 
depending on heuristics that might prema¬ 
turely rule out the right answer. Any set of 
observed features that is sufficient to select 
one of the stored descriptions will suffice, 
and if not enough features are present, the 
system will still narrow the set of possibili¬ 
ties down as much as possible. When new 
descriptions are added to the network, the 
knowledge immediately becomes an effec¬ 
tive part of the recognition process. We do 
not need to hire a programmer or knowl¬ 
edge engineer to specify exactly how and 
when each piece of knowledge is to be ap¬ 
plied. On the negative side, NETL treats 


every feature as an atomic entity that is 
either present or absent and expects that 
the winning description will explain all of 
the observed features. Like traditional 
symbolic AI systems, NETL works best in 
clean domains, far from the noise and eon- 
fusion of the low-level sensory inputs. 

The NETL architecture has been simu¬ 
lated, but not yet implemented directly. 
The node and link units are so simple that 
several thousand of them could fit on a 
single chip. The hard problem is to design 
the switching network that implements the 
node-to-link interconnections. A design 
study by Fahlman^ demonstrated that a 
NETL machine can be built for only a few 
times the cost of a conventional memory 
system able to hold the same amount of in;i_ 
formation. The Conneetion Maebine"* 
was designed in part to implement a 
NETL-like knowledge base, though the 
hardware is general enough to do other 
jobs as well. The current 64,(X)0-processor 
version of this m^hme is large enough to 
handle a substantial body of knowledge, 
by the standards of current AI systems. | 
The proposed million-processor version 
may be able to handle enough assorted 
knowledge to exhibit some degree of com¬ 
mon sense. 


Layered value-passing 
networks for recognition 

As we mentioned earlier, a marker¬ 
passing system like NETL does not grace¬ 
fully handle the messy recognition prob¬ 
lems we encounter in the real world. 
Whether we are dealing with vision, 
speech understanding, medical diagnosis, 
or some other real-world recognition 
problem, we normally face a situation 
where no match is ever perfect and in 
which few of the incoming features are 
noise-free and certain. Some features pro¬ 
vide strong evidence for particular hy¬ 
potheses; other features are only sugges¬ 
tive. Some features are clearly present; 
others are borderline cases or the result of 
low-confidence observations. Instead of 
the all-or-none set operations of NETL, 
we need a system that can combine many 
observations of varying quality and find 
hypotheses that fit well, even if they do not 
match perfectly. 

This kind of problem can be handled by 
a value-passing system , in which each con- 

nection has an ass ociated scalar wei^, . 

EacR unit euihputes a weighted sum of the 
incoming values and passes this sum 
through a nonlinear function, with the 
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Figure 3. Value-passing network to compare two six-bit patterns. Input patterns A 
and B are identical, except that pattern A may be rotated one position to the left or 
right from patterp B. The three output units represent a left rotation, no rotation, 
and a right rotation, respectively. This task cannot be done without some hidden 
units. In this network we employ 12 hidden units, though only three appear in the 
diagram. An appropriate set of weights can be learned using the back-propagation 
method. 


resulting value becoming the unit’s out¬ 
put. A value-passing network may be im¬ 
plemented in either digital or analog hard¬ 
ware, but computationally it can be 
viewed as a sort of analog computer. 

Using these value-passing units, we can 
set up a layered recognition system able to 
handle uncertain observations and varying 
degrees of evidence. Each directly observ¬ 
able feature is represented by an input unit 
whose value represents the probability 
that a discrete feature is present, the mag¬ 
nitude of a continuous quantity (like in¬ 
tensity), or the probability that a magni¬ 
tude lies within a particular interval. Each 
of the possible hypotheses that we wish to 
evaluate is represented by an output unit. 

In the simplest of these networks, the in¬ 
put units are connected directly to the out¬ 
put units by a set of connections with mod¬ 
ifiable weights. In such networks, it is not 
necessary to set the connection weights by 
hand. Given a set of input vectors and the 
desired output for each, the perceptron 
convergence procedure^ can be used to 
find a set of weights that will perform this 
mapping, if such a set exists. 

Unfortunately, for most interesting rec¬ 
ognition tasks there is no set of weights in a 
simple two-layer network that will do the 


job. In most cases, one cannot treat the 
lowest-level features as independent 
sources of evidence and simply add them 
up. It is necessary to introduce one or 
more intervening layers of hidden units, 
which combine the raw observations into 
higher-order features more useful in deter¬ 
mining the output. Consider, for example, 
the problem of deciding whether an image 
contains a telephone. The fact that a single 
pixel in the image has high intensity cannot 
be used directly as evidence for or against a 
telephone, because telephones can be 
black or white. It is necessary to extract 
relationships between pixel intensities 
(such as edges) before trying to detect the 
telephone. 

Figure 3 shows a simple task for which 
hidden units are essential. Pattern A is 
identical to pattern B, except that it may be 
rotated one step to the left or right. The 
task is to determine the shift for any pat¬ 
tern of input bits. This cannot be done 
without hidden units because each input 
bit, considered in isolation, provides no 
evidence whatsoever about the shift. All 
the information is in the joint behavior of 
combinations of input bits, so one or more 
layers of hidden units must be used to ex¬ 
tract informative multi-unit combina¬ 


tions, which then can be combined into an 
overall answer. 

Learning which of the exponentially 
many possible combinations are relevant 
for predicting the output is a hard prob¬ 
lem. Techniques such as back-propagation 
(described below) can indeed discover a set 
of weights and hidden-unit assignments 
that, taken together, will solve the prob¬ 
lem . Figure 4 shows some examples of hid¬ 
den units and associated weights taken 
from one such solution. 

Minsky and Papert* thoroughly ana¬ 
lyzed which tasks require hidden units and 
demonstrated that an insightful way of 
categorizing tasks is in terms of how many 
input units must connect to each hidden 
unit in a three-layer network (this deter¬ 
mines the order of the statistics that can be 
extracted). Unfortunately, they gave no 
procedure for learning appropriate hidden 
units, and suggested that there may not be 
any simple general procedure. 

For many years after Minsky and 
Papert’s book was published, AI research¬ 
ers criticized the connectionist approach 
because the effective learning procedures 
were restricted to networks incapable of 
performing tasks like figure-ground seg¬ 
mentation or viewpoint-independent 
shape recognition. More recently, a deeper 
appreciation of the sheer quantity of com¬ 
putation required and a better under¬ 
standing of the nature of the computations 
has led to renewed interest in massively 
parallel approaches to perception. ^ 

Learning 

representations 

Three-layered nets of the kind studied 
by Minsky and Papert do not have the 
freedom to choose their own representa¬ 
tions because the weights between the in¬ 
put units and the feature detectors in the 
middle layer are predetermined and do not 
learn. If we allow these weights to learn, 
the network can decide for itself what the 
units in the middle layer will represent. 
Consequently, we get a much more inter¬ 
esting and powerful kind of learning, espe¬ 
cially when extended to multiple hidden 
layers. However, finding learning proce¬ 
dures that choose good representations is 
difficult, and because the space of possible 
representations is very large, any proce¬ 
dure that explores the space in a random 
way will be very slow. 

One promising new procedure, called 
back-propagation, has been discovered in- 
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Figure 4. The weights learned by three of the twelve hidden units. The white squares are positive weights, the black squares are 
negative weights, and the area of a square is the magnitude of the weight. The bottom two rows in each hidden unit show the 
weights coming from the input units, and the top row shows the weights to the three output units that represent the three possible 
shifts. All the units shown learned positive thresholds (not shown here) so that they will not come on unless they receive a net 
positive input. Unit a detects some cases of right-shift; the two large negative weights prevent it from responding to left shifts. 
Unit b detects some no-shift cases. Unit c responds positively to shifts in either direction, but not to no-shift cases. 


dependently by David Rumelhart, David 
Parker, and Yann Le Cun. It involves two 
passes each time an input vector is pre¬ 
sented. In the forward pass, activity starts 
at the input units and passes through the 
layers to produce an output vector. In the 
backward pass, the derivative of the error 
(the difference between the actual output 
vector and the desired output vector) is 
back-propagated through the same con¬ 
nections but in the reverse direction. This 
allows the network to compute, for each 
weight, the gradient of the output error 
with respect to that weight. The weight is 
then changed in the direction that reduces 
the error. So learning works by gradient 
descent on an error surface in weight 
space. 

Back-propagation has already been 
shown capable of learning many different 
kinds of interesting representation in the 
hidden units. It can learn optimal codes 
for squeezing information through nar¬ 
row bandwidth channels, or sets of opti¬ 
mal filters for discriminating between very 
similar noisy signals. 

Sejnowskiand Rosenberg* showed that 
a back-propagation net can be trained to 
transform an input vector that encodes a 
sequence of letters into an output vector 
that encodes the phonemic features of the 
sequence; that phonemic output can then 
be used to drive a speech-synthesis device. 
From the input-output examples it sees 
during training, this system is able to ex¬ 
tract both the regularities exhibited by the 
mapping, such as the effect of a terminal 
“e” in changing the sound of the preced¬ 
ing vowel, and specific exceptions, such as 
the odd pronunciation of a word like 
“women.” This same task is performed in 
commercial speech-generation systems by 


conventional programs of considerable 
size and complexity. 

Back-propagation can also be used to 
learn the semantic constraints that under¬ 
lie a set of facts. One five-layer network® 
was trained on a set of 1(X) triples such as 
(Victoria has-father Christopher) or 
(Christopher has-wife Penelope) derived 
from two family trees involving people of 
two nationalities. The input vector repre¬ 
sented the first two terms of a triple and 
the required output vector represented the 
third term. As far as the network was con¬ 
cerned, these input vectors were just arbi¬ 
trary symbols, but after extensive training 
the network could generalize appropriately 
to triples on which it had not been trained, 
like (Victoria has-mother ??). By recording 
the set of triples for which each of the hid¬ 
den units became active, it was possible to 
show that these units had learned to repre¬ 
sent important properties like “Italian” or 
“old” that were never mentioned in the in¬ 
put and output. 

Back-propagation does gradient de¬ 
scent in the space of possible representa¬ 
tional schemes, and these semantic features 
happen to be a very good representation for 
the relationships the network is trained on. 
The hidden features and their interactions 
encode the underlying regularities of the 
domain. When viewed locally, the learning 
procedure just tunes the weight parame¬ 
ters, but the global effect is that the net¬ 
work does structural learning, creating 
new terms that allow it to express impor¬ 
tant regularities. This example also il¬ 
luminates the “local versus distributed” 
issue. The network’s internal representa¬ 
tion of each person is a distributed pattern 
of active semantic features, but each of 
these local features captures an important 


underlying regularity in the domain. 

Back-propagation has similarities to the 
Baum-Welch algorithm for tuning param¬ 
eters in a stochastic, finite-state auto¬ 
maton. These trainable automata are 
widely used as generative models in practi¬ 
cal speech-recognition systems'® and 
there is some hope that procedures like 
back-propagation will be able to improve 
on these models by overcoming an impor¬ 
tant limitation. In a finite-state auto¬ 
maton, the system’s knowledge of what it 
has produced so far is encoded as the cur¬ 
rent node in a graph of states and transi¬ 
tions. So if the automaton needs to re¬ 
member 20 bits of information about the 
partial sequence to constrain the rest of the 
sequence, it requires at least 2 2® nodes. In 
a connectionist network, many units can 
be active at once, so the number of units 
need not grow exponentially with the 
amount of information that must be car¬ 
ried along in generating a sequence. 

Another interesting new learning proce¬ 
dure, called A R.p, was described by Andy 
Barto." He showed how layered net¬ 
works of relatively simple stochastic units 
can learn to cooperate in order to max¬ 
imize a global payoff signal that depends 
on the output vector and is received by 
every unit. Like back-propagation, this 
procedure learns Interesting internal repre¬ 
sentations, but it is slower because it dis¬ 
covers the effect of changing a weight by 
sampling the effects of random variation 
instead of by explicit computation of the 
gradient. The A R.p model is exciting as a 
biological model because it does not need a 
separate pass in which to back-propagate 
detailed error information. 

A major criticism of all the current mul¬ 
tilayer learning procedures is that they are 
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slow even for modest examples and they 
appear to scale poorly. The obvious prob¬ 
lem of gradient descent—that it will get 
stuck in a poor local minimum—turns out 
to be only a minor problem in practice. 
The real difficulty is that simple gradient 
descent is very slow because we have infor¬ 
mation about only one point and no clear 
picture of how the surface may curve. In 
high-dimensional spaces the error surface 
usually contains ravines that are highly 
curved across the ravine and slope gently 
downwards along the ravine. Small steps 
take forever to meander down the ravine, 
and big steps cause divergent oscillations 
across the ravine. Even with a large speed¬ 
up from faster implementation technol¬ 
ogy, these learning techniques are too slow 
to handle many problems of interest. 
Future progress may well depend on dis¬ 
covering ways of partitioning large net¬ 
works into relatively small modules that 
can learn more or less independently of 
each other. 


Constraint-satisfaction 
in iterative networks 

The idea that perceptual interpretation 
consists of transforming an input vector 
through successive layers of units until it 
becomes a categorization is rather restric¬ 
tive. Most real recognition tasks require 
that multiple layers of features be recog¬ 
nized all at once and that the result of per¬ 
ception be a coherent, articulated struc¬ 
ture rather than a single category. In visual 
recognition, for example, we might have a 
scene, various objects in the scene, their 
parts, and subparts, all constraining one 
another and all relating in complex ways to 
the low-level stimuli the system is receiv¬ 
ing. An African context provides evidence 
in favor of seeing an elephant. An ele¬ 
phant helps us to identify an African 
scene, and that in turn can help us to spot 
the giraffe. The trunk, tusks, and ears all 
are features that help us to recognize an 
elephant. Likewise, knowing that we’re 
looking at an elephant helps us to recog¬ 
nize the elephant’s parts. 

In a situation like this, we want to start 
with a network that records the tangle of 
interlevel constraints and evidence rela¬ 
tionships, put in our observations as a sort 
of boundary condition, and get the system 
to settle into the best possible solution (or 
set of solutions) spanning all the levels of 
description. Some constraints and expec¬ 
tations will be violated, but we want to 


find the best-scoring constellation of deci¬ 
sions overall. ^ 

The task is similar to finding the solu¬ 
tions to a set of simultaneous equations. A 
value-passing network would seem a sensi¬ 
ble parallel way of converging on a good 
solution—a sort of analog computer with 
links representing the constraints. Non- 
learning-constraint networks of this sort 
have been studied for a variety of problem 
domains, most notably at the University 
of Rochester. In some simple cases, the 
network can be guaranteed to settle to the 
best final state no matter what values it 
starts with, but for more difficult prob¬ 
lems, especially ones that involve discrete 
decisions, a value-passing network with 
loops and many nonlinear decision ele¬ 
ments is generally not well-behaved. Such 
networks tend to oscillate or to get trapped 
in uninteresting states that do not repre¬ 
sent good solutions to the problem. 

Hopfield and Boltzmann 
networks for constraint 
satisfaction 

One way to guarantee that a network 
will settle down is to show that there exists 
some cost function that decreases every 
time one of the values changes. Hummel 
and Zucker’^ showed that there exists 
such a function for networks that pass 
values and have symmetrical connections. 
At about the same time, Hopfield iden¬ 
tified a cost function (which he called 
“energy”) for networks of symmetrically 
connected binary threshold units. 

Hopfield’s energy function can be inter¬ 
preted in the following way: A connection 
between units i and j with a positive weight 
represents a constraint that if one of these 
units is on, the other one should be also. A 
negative connection weight says that if one 
of the units is on, the other should not be. 
The weight corresponds to the penalty to 
be applied if the constraint is violated. The 
energy of any state of the network is given 
by 

E= -E spjWij+Y, SiQi 
i<J ' 

where wy is the weight on the connection 
between units i and j, 5,- is 1 if unit / is on 
and 0 otherwise, and 0, is a threshold for 
unit /. 

Given Hopfield’s quadratic definition 
of energy, each unit / can determine the 
difference between the global energy of 
the network when it is off and the global 


energy when it is on, given the current 
states of the other units. This energy gap is 
simply 

Eioff-Eion = ^rZ^j'^iJ 

If the energy gap is positive, the unit 
should turn on (or stay on) to minimize the 
global energy. Otherwise it should turn off 
(or stay off). In other words, to minimize 
energy it should behave exactly like a 
binary threshold unit. 

Hopfield originally proposed his model 
as a theory of memory. Each local mini¬ 
mum corresponds to a stored vector, and 
the memory is content-addressable be¬ 
cause if it is started anywhere near one of 
the stored states it normally converges on 
that state. The same kind of network can 
also be used for perceptual interpretation 
by defining some of the units as input units 
and clamping their states on or off to 
represent the current perceptual input. 
The other units then settle into a low- 
energy global state consistent with these 
boundary conditions. This state represents 
a locally-optimal solution given this set of 
inputs, but with no guarantee that it is the 
global optimum. 

The Boltzmann machine architec¬ 
ture*^’'® is essentially a Hopfield net¬ 
work (with hidden units) that uses a simu¬ 
lated annealing search to escape from local 
minima. This same general idea, with 
some differences of emphasis, was inde¬ 
pendently proposed by other research 
groups '’’** at about the same time. 

Simulated annealing is a search tech¬ 
nique that has been applied to a number of 
optimization problems. *® The idea is that 
we escape from high local minima by add¬ 
ing a random component to the decision 
process of each unit. In most cases, the 
unit still takes a step downhill, but occa¬ 
sionally it will take a step uphill instead. 
More precisely, each unit i computes the 
AE/ value as above, then assumes the 1 
state with probability p, given by the 
following formula: 

1 

^'■= i+e-A£,./r 

The T term is a scaling factor that con¬ 
trols the amount of noise. It is analogous 
to a temperature: For large 7’,pis about .5 
and the system assumes states at random, 
ignoring the constraints in the network; 
for T = 0, the random element is elimi¬ 
nated, and the system behaves as in the 
pure Hopfield net, moving downhill into 
the nearest loeal minimum. At any given 
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T, once the system has reached thermal 
equilibrium, the relative probability of 
being in state A versus state B (see Figure 
5) obeys a Boltzmann distribution: 

^ =e-(£A-£B)/F 

Pb 

Thermal equilibrium does not mean that 
the system has settled into a particular 
stable state. It means that the probability 
distribution over states has settled down, 
even though the states are still changing. A 
deck of cards is at thermal equilibrium 
when it has been shuffled for long enough 
that the probability of finding any card in 
any position is 1 /52, even though the cards 
keep moving around. The best way to 
reach thermal equilibrium at a given tem¬ 
perature is generally to start at a higher 
temperature, which makes it easy for the 
system to cross energy barriers but gives it 
little preference for the lower energy 
states. Then we gradually increase the 
preference for low energy states by reduc¬ 
ing T. If Tis reduced slowly enough, there 
is a high probability of ending up in the 
best global state, or if not there, in a state 
not much worse than the best. This pro¬ 
cess of slow cooling is analogous to slow 
annealing of a metal in order to crystallize 
it in its lowest energy state. 

Boltzmann networks, designed by hand 
and running on a serial simulator, have 
been demonstrated successfully on a num¬ 
ber of constraint-satisfaction problems, 
such as the separation of figure and 
ground in a two-dimensional image. 
Touretzky^® is investigating ways of im¬ 
plementing symbolic processing, includ¬ 
ing a production system interpreter and a 
system that can manipulate lists and tree 
structures, using Boltzmann-type net¬ 
works. But most of the interest in Boltz¬ 
mann machines is due to a learning proce¬ 
dure, described later, that enables them to 
program constraints into their connec¬ 
tions when shown examples of good solu¬ 
tions to a problem. 

Hopfield and Tank investigated a dif¬ 
ferent method to avoid being trapped in 
local minima: They used real-valued, ana¬ 
log, nonlinear elements that obey the same 
equation as the units in a Boltzmann ma¬ 
chine but send out a deterministic real 
value instead of a single stochastic bit. Re¬ 
ducing the temperature in a Boltzmann 
machine is equivalent to raising the gain 
(the nonlinearity) of their analog units, 
and they have shown that they can approx¬ 
imate simulated annealing without actual¬ 
ly simulating a stochastic system directly. 


As the gain is increased, single minima of 
the low-gain energy surface develop a fine 
structure of smaller minima. 

Hopfield and Tank’s approximation 
loses all information about the higher- 
order statistics. For example, they would 
represent a stochastic system that spent 
half its time in the state (1, 1) and half its 
time in the state (0, 0) by the mean values 
(0.5, 0.5). But the very same representa¬ 
tion would be used for a system that 
spends half its time in the state (1, 0) and 
half in the state (0, 1). It is not yet clear 
how important this loss of higher-order 
statistical information is. 

Networks of this type have been applied 
to a variety of problems, the most ambi¬ 
tious of which is the Traveling Salesman 
Problem, for which the network finds 
moderately good solutions very fast. Hop- 
field’s group has shown a particular en¬ 
thusiasm for implementing their networks 
in silicon, rather than simulating them, 
and a number of small-scale physical im¬ 
plementations have appeared. At the same 
time, Hopfield has been working with 
Tank to investigate the possible connec¬ 
tion between these networks and real 
neurons. 

Hopfield’s group has chosen not to 
focus on the problem of learning what to 
do with extra, hidden, units whose re¬ 
quired behavior is not specified by the task 
definition. These are not needed if the ex¬ 
perimenter decides how to represent 
things, but they are crucial if the network 
is to be given the freedom to develop its 
own representations. There exists an itera¬ 
tive form of the back-propagation learn¬ 
ing procedure that can learn how to use 
hidden units in a Hopfield and Tank net¬ 
work and can also learn an optimal sched¬ 
ule for varying the gain of the units during 


the search process. If the same learning 
procedure is applied to nets with asym¬ 
metric connections, they can be trained to 
produce sequences. The learning pro¬ 
cedure is infeasibly slow for large nets, so 
the research currently divides into studies 
of search in larger nets, built by hand, and 
learning in smaller nets. 

The Boltzmann machine 
learning procedure 

The Boltzmann learning scheme is sur¬ 
prisingly simple. It has two versions; we 
will describe the version in which there are 
input units and output units and the ma¬ 
chine must learn to map input vectors into 
output vectors. We begin with a set of I/O 
patterns on which the network is to be 
trained. The goal is to adjust the weights 
of the network so that, when we clamp the 
input units into one of these patterns and 
anneal the network, the corresponding 
output pattern will appear on the output 
units. If we clamp the inputs into a pattern 
that the system has not seen before, we 
would like the system to generalize accord¬ 
ing to the underlying regularities in the I/O 
pairs that it has seen. 

The learning cycle has two phases, posi¬ 
tive and negative, followed by weight ad¬ 
justment. During the positive phase, we 
cycle through the entire set of I/O pairs. 
Each of these, in turn, is clamped into the 
input and output units and the rest of the 
network is then annealed, starting with a 
high temperature and gradually cooling 
down to thermal equilibrium at a tempera¬ 
ture of 1. Once the system is close to 
equilibrium, we keep running it for a few 
more cycles, during which time each con- 
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nection keeps a record of how often the 
two units it joins are on at the same time. 
After all of the I/O pairs have been pre¬ 
sented in this way, each connection will 
have recorded a value, p +, which is the 
fraction of time during the positive phase 
in which the two connected nodes are on at 
the same time at thermal equilibrium. 

The negative phase is identical, except 
that only the inputs are clamped; the out¬ 
put units are allowed to settle into what¬ 
ever states they like. In a network that has 
learned perfectly, the output units will ex¬ 
hibit the same probability distribution 
over output vectors as they would if we 
were still clamping them along with the in¬ 
puts. During the negative phase we again 
run for a few more cycles after reaching 
equilibrium. Each connection records a 
second value, “, the fraction of time in 
which its two units are both active during 
the negative phase. If the network is pro¬ 
ducing all the right answers, the output 
units will exhibit the same probability 
distribution whether or not we clamp them 
and p + will be the same as /? “. If p + 
and p “ differ for a given connection, the 
two probability distributions can be made 
to match better by changing that connec¬ 
tion’s weight. If we ignore sampling noise, 
the difference between p + and p “ is ex¬ 
actly equal to the gradient of an informa¬ 
tion theoretic measure of the difference 
between the system’s output behavior 
(during the negative phase) and its desired 
behavior (during the positive phase).So 
we can perform steepest descent in this dif¬ 
ference measure by changing the weight by 
an amount proportional to p ^ - p~ ■ 

Even though Boltzmann machines only 
contain pairwise connections, the learning 
procedure allows them to capture higher- 
order constraints by dedicating hidden 
units to represent higher-order features. 
The learning procedure is interesting 
because it decides what the hidden units 
should represent, and it typically chooses 
to use distributed representations. 

Unfortunately, the Boltzmann machine 
learning procedure suffers from all the 
usual problems of gradient descent in large 
parameter spaces. On top of this, the 
estimated gradient is usually inaccurate. 
The proofs assume that we have a large, 
unbiased sample of the statistics at 
equilibrium in the positive and negative 
phases. In practice, we never quite reach 
equilibrium, so the statistics are sys¬ 
tematically biased. Moreoever, unless we 
are very patient there is also sampling error 
caused by taking too few samples. 

Despite these difficulties, Boltzmann 


machines have been used successfully for 
aspects of speech recognition.^^ The 
simplicity of the Boltzmann machine ar¬ 
chitecture makes it feasible to build VLSI 
chips that contain many units, and it is just 
possible that this will lead to sufficient 
speed to make this a practical scheme. 
Even so, the scaling properties are poor 
and very large networks will remain im¬ 
practical unless clever scaling tricks are 
discovered. 


T en years ago there were no connec- 
tionist learning procedures power¬ 
ful enough to build useful represen¬ 
tations with multiple layers of hidden units. 
Now there are many. The current challenge 
is to develop faster learning schemes that 
can be scaled up to networks with millions 
of modifiable connections. □ 
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by Error Propagation,” Parallel Distributed 
Processing: Explorations in the Microstructure 
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Ask us! 



Scott E. Fahlman is a senior research computer 
scientist in the computer science department of 
Carnegie-Mellon University. His primary 
research interest is in massively parallel com¬ 
puting architecture for such AI problems as 
recognition, knowledge representation, learn¬ 
ing, and simple kinds of search and inference. 
He has also been active in the definition, im¬ 
plementation, and standardization of the Com¬ 
mon Lisp language. 

Fahlman is a founder of Expert Technologies 
Inc. and Lucid Inc. and consults for Siemens 
Central Research Laboratories in Munich. He 
received his PhD from MIT in 1977, where he 
also received his BS and MS. 



Geoffrey E. Hinton is an associate professor in 
the computer science department at Carnegie- 
Mellon University. His main research interest is 
in models of computation in the brain. 

Hinton received a PhD in AI from Edin¬ 
burgh University in 1978. He has been a 
research fellow in AI at Sussex University, a 
visiting scholar in cognitive science at UC San 
Diego, and a research scientist at the Applied 
Psychology Unit in Cambridge, England. 

Readers may write to Fahlman at the Com¬ 
puter Science Dept., Carnegie-Mellon Universi¬ 
ty, Pittsburgh, PA 15213. 


In the Advanced Technology 
directorate of ESL (a 2500 
person company), our charter 
is to develop the most imagi¬ 
native and necessarily uncon¬ 
ventional solutions to deal 
with some of the hardest 
signal processing problems 
and missions confronting our 
Nation. 

Our goals: 

At ESL, we are only interested 
in developing Advanced Tech¬ 
nology Solutions for missions 
vital to our National Defense. 

Our technology: 

From Multi-Gigaflop Advanced 
Digital Signal Processor Sys¬ 
tems, to Full-Custom 1.25 
micronCMOS VLSI micro- 
circuits, to Wafer-Scale Inte¬ 
grated GigaflopSystolic Proc¬ 
essors, to MIPS and 68020 
Based, Tightly-Coupled Dis¬ 
tributed Computing Systems, 
to High-Speed Data-Flow 
Systems, to Artificial Intelli¬ 
gence Systems. 

Our missions: 

From Acoustic Signal Process¬ 
ing, to ESM/ELINT Systems, 
to Tracking Missions, to 
Advanced COMINT, to other 
Tactical & Strategic Surveil¬ 
lance and Reconnaissance. 

Our business: 

We are currently enjoying 
record business growth due to 
the quality of our work and 
our ability to provide products 
which meet our customers' 
needs. 


Our requirements: 

We are only interested in 
self-motivated, innovative, 
responsible, and curious engi¬ 
neering professionals, from 
the disciplines of Electrical 
Engineering, to Computer 
Science/Engineering, to Math¬ 
ematics, to Physics and other 
Physical Sciences. 

Our needs: 

Openings exist at all levels: 
Managers, Staff Engineers, 
Engineers, System Architects, 
and Designers. PhD or equiva¬ 
lent, with clear track record 
of doing something big. 

Your move: 

At ESL, you'll find excellent 
salaries and benefits comple¬ 
mented by a stimulating, 
health-oriented environment. 
Please send resume to Bijoy 
G. Chatterjee, Deputy Direc¬ 
tor, Advanced Technology, 
Dept. COM-781, ESL, 1345 
Crossman Ave., P.O. Box 
3510, Sunnyvale, CA 94088- 
3510 or call him directly at 
(408) 743-6254. An equal 
opportunity employer. U.S. 
CITIZENSHIP IS REQUIRED 
FOR ALL POSITIONS. 
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And it's ESL. 
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March 30 - April 2, 1987 
Monterey, CA, USA 



TH Annual 

International Conference on 


SOFTWARE ENGINEERING 


Formalizing and Automating the Software Process 


The rh&msFormalizing and Automating the Software Process identifies the two essential activities for realizing the 
potential of Software Engineering. The first is to rigorously define software creation and evolution processes. The 
second is to create organizational and automated systems supporting these processes. This theme has guided the 
definition of a Technical Program organized into Process, Formalism and Automation Tracks, a Tutorial Program 
providing background information, and a Tools Fair in which a variety of available technology will be demonstrated. 

Each of the tracks in the Technical Program includes major talks, papers, workshop reports and panels that collectively 
expose and integrate relevant, current activities. The Process Track concerns approaches to defining, measuring, 
assessing, modifying and evolving software processes. Automated and organizational systems supporting these 
processes are the subject of the Automation Track. The Formalism Track covers both the use of formalism within the 
processes and the rigorous definition of the processes, their constituent activities and the supporting organizational and 
automated systems. 

The Tutorial Program precedes the other activities and provides in-depth, one-day introductions to a variety of technology 
pertinent to formalizing and automating the software process. The program covers database technology supporting 
software engineering, software development environments, knowledge-based programming environments, formal 
specification and verification techniques, and software reusability. 

The Tools Fair includes demonstrations of both production and prototype tools. It also includes in-depth, technical 
presentations covering particularly interesting and innovative tools. The Tools Fair parallels the Technical Program and 
its activities are scheduled to allow attendance at both activities. 


CHAIR 

William E. Riddle 
Software Productivity Consortium 
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Robert M. Balzer 

(JSC Information Sciences Institute 
Kouichi Kishida 

Software Research Associates, Inc. 
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Larry E. Druffel 
Software Engineering Institute 
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University of Massachusetts 
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Richard E. Fairley 
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William M. Murray 
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TECHNICAL PROGRAM 


Software Processes Are Software Too 
L. Osterweil 


Understanding and Assessing the Software Process 
W. Curtis, M. Dowson, W. Humphrey 
Measuring and Modeiing the Software Process 

W. Ehrlich, T. Emerson, A. Goel, H. Mills, Y. Miyazaki, N. Murakami, J. Musa 
Empirical Studies of the Software Process 
participants to be determined 
Processes for Achieving Dependable Software 
participants to be determined 
Some Existing Software Process Models 
P. Feiler, G. Kaiser, D. Schwartz, D. Serbanati 
Software Process Assessments and Improvements 

M. Harandi, J. Kelly, M. Lubars, T. Nomura, D. Ogle, R. Ramnath, K. Schwan, S. Vasudevan 
Software Process Management: Lessons Learned From History 

B. Boehm, W. Royce and others to be determined 
Approaches to Improving Software Processes 

V. Basili, L. Druffel, J. Elmore, R. Fairley, K. Kishida, M. Lehman, W. Riddle, D. Rombach and 
others to be determined 
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The Use of Formalisms in Software Engineering 
D. Bjdmer 

Database Technology and Software Engineering 

P. Bernstein, R. Fairley, N. Goldman and others to be determined 
Formal Specification Languages 

E. Berliner, K. Futatsugi, J. Goguen, B. Kramer, J. Mesequer, K. Okada, P. Zave 
More Formal Specification Languages 
P. Ladkin, D. Perry, G. Roman 
State-of-the-Art in Transformation Technology 
W. Feather, W. Scherlis 

Practical Application of Specification Technology 
participants to be determined 
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Automating the Software Process 
V. Stenning 

Artificial Intelligence and Software Engineering 

D. Barstow, B. Boehm, C. Williams and others to be determined 
Intelligence in User Interfaces: Is It Necessary? 

participants to be determined 
Supporting Version Control 
D. Perry, J. Winkler 
User Interface Support 

C. Rathke, S. Reiss 

A Sampling of Existing Environments 
participants to be determined 
Prospects for Future Environments 

T. Cheatham, R. Taylor, C. Tully, T. Yokoi and others to be determined 
Support for Evolution and Reuse 

D. Embley, G. Fischer, S. Katz, A. Lemke, C. Rathke, C. Richter, K. The, S. Woodfield 
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Individual and International Property Rights: How Serious is the Problem? 

R. Balzer, R. Banin, D. Bradin, P. Samuelson and others to be determined 













TOOLS FAIR 


31 March - 2 April 1987 


The Tools Fair runs parallel to the Technical Program, scheduled to allow attendance at both activities. The 
purpose of the Tools Fair is to provide conference attendees an opportunity to view a variety of production and 
prototype software development tools, toolsets and environments from both the research community and industry. 

Individual tools, integrated toolsets and full-scale environments will be demonstrated in an exhibition area, 
providing the opportunity to gain first-hand experience and informally discuss technical details. In addition, a 
sequence of special presentations will be devoted to the description and demonstration of the technical details of 
particularly interesting or innovative technology. 


Applications for space within the exhibition area and proposals for special presentations 
must be received by 30 January 1987. Presentation proposals will be judged on the 
depth of technical content, freedom from marketing "hype," and suitability for 
illustrating interesting and novel aspects. Applicants for space in the exhibition area 
are advised that marketing activity will not be allowed. 


To request exhibition space or propose a special presentation, 
contact either of the Tools Fair Chairs: 


Larry E. Druffel (412) 268 7740 
Jack C. Wileden (413) 545 0289 


30 March 1987 


TUTORIALS 


The Tutorial Program includes several in-depth, one-day introductions to a variety of technology pertinent to 
formalizing and automating the software process; 


Database Technology for Software Engineering 


John Nestor 
Software Engineering Institute 
Richard Snodgrass 
University of North Carolina, Chapel Hill 


Software Development Environments 


Peter B. Henderson 
Slate University of New York at Stony Brook 
Mark Ardis 
Wang Institute 


Formal Specification and Verification 


Richard A. Kemmerer 
University of California, Santa Barbara 


Knowledge-based Programming Environments 


David R. Barstow 
Schlumberger-Doll Research 


Software Reusability 


John B. Goodenough 
Software Engineering Institute 








LODGING RESERVATION FORM 
CUT-OFF DATE: 23 February 1987 

PROCEDURE: 

1. Send this form to: 

ICSE-9 Housing Bureau 

Monterey Peninsula Housing & Convention Bureau 
PO Box 1770 
Monterey, CA 93940 

Complete the charge authorization or enclose a check, for 
one night's lodging, payable to Monterey Peninsula 
Visitors and Convention Bureau. 

2. Block reservations will not be accepted. 

3. Phone reservations will not be accepted by either the 
bureau or the participating hotels/motels. 

4. List a first, second and third choice; your reservation will 
be made at your most preferred, available hotel/motel. 

5. You will receive your room confirmation directly from the 
hotel/motel. 

6. The rates listed do not include room tax. 

7. Suite requests must be made in writing to lCSE-9 Suite 
Request, MPV&CB, PO Box 1770, Monterey, CA 93940. 

8. Notify the Monterey Peninsula Vistors and Convention 
Bureau, in writing, of any cancellations or changes in your 
reservation before 15 March 1987. After 15 March 1987, 
contact the confirming hotel/motel directly. Deposits will 
be refunded only with 72-hour cancellation notice. 

(Please type or print) 

Name: _ 

Organization: 

Address: 


Phone: ( )_ 

Room Preference: _Single _Double 


CONFERENCE REGISTRATION FORM 

PROCEDURE: 

1. Send this form to: 

ICSE-9 Registration 
Computer Society of the IEEE 
1730 Massachusetts Ave., NW 
Washington, DC 20036-1903 

2. To guarantee your registration, complete the charge 
authorization or enclose a check payable to Computer 
Society of the IEEE. 

3. Members of sponsoring organizations are eligible for 
the reduced Member Fees. Please indicate the sponsoring 
organization and your membership number when 
claiming these fees. 

4. The Conference Fee includes admission to the technical 
sessions, admission to the Tools Fair, one copy of the 
Conference Proceedings (except students), refreshments 
at breaks, and receptions. 

5. The Tutorial Registration Fee includes tutorial notes and 
lunch. 

6. Refunds (less a $15 handling fee) will be made if a 
request is received in writing by 15 March 1987. 

(Please type or print) 

Name: - 

Organization: _ 

Address: - 


Phone: ( ) . 
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_ Database (Nestor/Snodgrass) 

_ Environments (Henderson/Ardis) 

_ Formal (Kemmerer) 

_ Knowledge-based (Barstow) 

_ Reusability (Goodenough) 


Hotel/Motel Preference: please indicate your preference using 


1st, 2nd, 3rd, etc. Single: 

_ Casa Munras - standard $65 

_ Casa Munras - delux $75 

_ Doubletree $95 

_ Hilton Inn Resort $89 

_ Hyatt Regency $95 

Monterey Beach - gardenside $55 

Monterey Beach - oceanfront $65 

__ Monterey Beach - hills view $112 

_ Monterey Beach - cannery row view $128 

_ Monterey Beach - ocean view $144 

_ Monterey Beach - deluxe ocean view $160 

Sheraton $95 


Double: 

$65 

$75 

$110 

$99 

$95 

$55 

$65 

$112 

$128 

$144 

$160 

$105 


FEES: Advance Registration (Prior to 25 Feb 1987) 

Member Non-Member Student/Retired 

Conference $160 $200 $25 

Tutorial $125 $155 $50 

Late Registration (After 25 Feb 1987) 
Member Non-Member Student/Retired 

Conference $200 $250 $35 

Tutorial $155 $195 $60 

Conference Fee: - 

Society:- 

Membership Number:- 

Tutorial Fee: - 

TOTAL FEE: - 


Credit Card: _Visa_MasterCard_Choice_AmExpress 

Credit Card Number:_ 

Expiration Date: - 

Cardholder's Name: _ 


Credit Card: _Visa_MasterCard_Choice_AmExpress 

Credit Card Number:-—- 

Expiration Date: --- 

Cardholder's Name: ____ 


Signature: 
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BOOK REVIEWS 


Expert Systems and Fuzzy Systems 


Constantine V. Negotia 
(Benjamin/Cummings Pub. Co., 
Menlo Park, Calif., 1985, 190 pp., 
$37.95) 

This book provides an excellent intro¬ 
duction to the subject of fuzzy systems 
and its influence in the design of expert 
systems. The formal theory of fuzzy 
sets, knowledge representation in the 
design of knowledge engineering sys¬ 
tems, decision support systems, and 
management expert systems are the 
book’s major topics. 

According to the author, the book’s 
aim is to “give the reader the mathe¬ 
matical background necessary to under¬ 
stand the algorithms used in approx¬ 
imate reasoning.” This he has suc¬ 
cessfully accomplished. 

Chapter 1 introduces expert systems 
and logic programming and gives a brief 
overview of the rest of the chapters in 
the book. The logic of inferencing and 
instantiation and the concept of approx¬ 
imate reasoning in fuzzy systems are 
elucidated in Chapter 2. Chapter 3 con¬ 
tains a complete and comprehensive in¬ 
troduction to the algebra of fuzzy sets. 

In the next three chapters the author 
considers the role of the mathematics of 
fuzzy sets in the realization of expert 
systems. Knowledge representation in 


the knowledge databases of an expert 
system and verbal models form the sub¬ 
ject matter of Chapter 4. This chapter 
provides, through examples, a demon¬ 
stration of how fuzzy set technology 
yields realistic norms for manipulating 
linguistic values. Chapter 5 demonstrates 
how the application of rules of inference 
to natural language statements translated 
into fuzzy sets results in other fuzzy sets; 
when translated, these sets lead to ap¬ 
proximate consequents of the original 
premises. Moreover, this inferencing 
mechanism is developed through models 
of fuzzy systems. The ability to model 
vagueness using the fuzzy set approach 
is considered in Chapter 6. The author 
contends that fuzzy linear programming 
has now been sufficiently developed to 
allow the use of verbal models for auto¬ 
matic transfer of knowledge. The pro¬ 
cess of converting a fuzzy model to a 
conventional model is also presented in 
this chapter, enabling the reader to 
realize that the large repertoire of ex¬ 
isting conventional algorithms in the 
area of expert systems can be easily used 
in an expert system using the fuzzy set 
approach. 

Chapter 7 concentrates on manage¬ 
ment expert systems. 

Each chapter has a comprehensive 


summary section that helps the reader to 
review material when necessary and a 
readings section containing not only the 
relevant references, but also a lucid ex¬ 
planation identifying the scope and per¬ 
tinent aspects of the subject matter. An 
appendix on categorial analysis and an 
extensive bibliography are also included. 

Because it provides them with the re¬ 
quired formal aspects of fiizzy sets in 
relation to expert systems, the book is a 
good reference book for practicing engi¬ 
neers with the relevant background in 
logic reasoning. It may not be possible, 
however, to use this book exclusively as 
a textbook in a course on expert sys¬ 
tems, even though the author states so, 
in the preface. 

Actual implementations of expert sys¬ 
tems have not been provided: it would 
have been ideal if a chapter on “real 
life” systems had been included. The 
absence of exercises in the book is 
another disadvantage. However, the 
overall organization of the book is ex¬ 
cellent and it is almost error-free. (The 
reviewer noticed a typo in the last line of 
Page 110.) 

Pani N. Chakrapani 

Associate Professor of Eng./CS 

University of Redlands 


Fundamentals of Digital Electronics 


George Rutkowski and Jerome Oleksy 
(Prentice-Hall, Englewood Cliffs, N.J., 
1985, 273 pp., $24.95) 

Targeted to technicians in industry, 
this book can also be used as a primer 
for undergraduate students having trou¬ 
ble understanding digital concepts. The 
authors, in a summary of their goals, 
have expressed the need to teach digital 
electronics in an interesting and dynamic 
way by including easy-to-visualize prob¬ 
lems and “many blinking lights” in the 
laboratory experiments. 

The line diagrams are clear and easy 
to understand, and the chapter sum¬ 
maries at the end of each chapter provide 
a quick overview. 

The philosophy of the authors has 
been to provide hands-on experience im¬ 
mediately after exposure to the concepts 
in the text and, in this way, to produce a 
technician who is not just a textbook ex¬ 
pert but also is actually familiar with the 
hardware. 


Some highlights: 

Chapter 1 deals with diodes and their 
applications; Chapter 2, with transistors 
and their applications; and Chapter 3, 
field-effect transistors for logic circuits. 
A brief introduction is given in each 
chapter. Chapter 3 mentions the con¬ 
struction and behavior of the FET. 
Practical CMOS inverters and ICs are 
also discussed, and a quiz is provided at 
the end of the text to test understanding 
of the material. Finally, toward the end 
of the chapter, two experiments are 
treated in detail. 

Other chapters deal with monostables, 
counters, flip-flops, square-wave gener¬ 
ators, gates, and binary numbers. 1 
think it would be unreasonable to expect 
a chapter on microprocessors that could 
do justice to the subject, but it is an in¬ 
escapable fact that microprocessors have 
become an integral part of digital 
electronics. 


Chapter 16 on digital applications ties 
together many concepts and circuits in¬ 
troduced in previous chapters. The aim 
of the authors in this final chapter is to 
familiarize the student with complete 
digital systems and with the interaction 
of several circuits working together to 
do a task. 

I think the authors have succeeded in 
their goal of exposing the student to a 
broad range of digital fundamentals and 
hardware, while preparing them to easily 
adapt to more extensive systems. How¬ 
ever, 1 did not quite understand how the 
book encourages team work, one of the 
authors’ stated goals. Synergy is an at¬ 
titude that cannot, perhaps, be taught so 
easily. 

On the whole, the authors should be 
congratulated on an important job well 
done. 

Chandan Sen 

Research Triangle Institute 
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“Any clod can have the facts, 
but having opinions is an art.” 

Charles McCabe 
San Francisco Chronicle 


sna 


Does more performance mean less utility? 


Computer science consists of showing 
that a task can be done at all. Computer 
engineering involves doing what you 
know can be done cheaply. Architectur¬ 
al features that may be useful for doing 
good computer science can actually get 
in the way of doing good computer en¬ 
gineering. We make a mistake when we 
try to use machines built to do comput¬ 
er science to do computer engineering. 

Much of computer science is predi¬ 
cated on simply building faster ma¬ 
chines. As our computer systems become 
faster they are also becoming more com¬ 
plex and less deterministic in time. This 
makes it harder to apply the machines to 
real problems. The folk wisdom is that 
the increased speed more than makes up 
for the increased complexity and de¬ 
creased determinism. In other words, do¬ 
ing lots of ill-defined, ill-informed things 
quickly beats doing a few well-defined, 
well-informed things slowly. I think it’s 
time we examined this piece of folk 
wisdom. 

First, let’s look at complexity. We’re 
told that the answer to the complexity 
problem is tools. But as complexity 
grows, the tools must necessarily focus 
more and more on the solution technolo¬ 
gy and less and less on the problem we’re 
trying to solve. This is an unfortunate 
trend because the wellspring of both 
solution quality and efficiency is to be 


found in the understanding of the prob¬ 
lem domain not the solution domain. 

Second, let’s consider time indetermin¬ 
ism. Can you imagine building a house 
with lumber whose dimensions can vary 
up to 50 percent? In other words, when 
you order an 8-foot board you might get 
a 4-foot board and you might get a 
12-foot board. Yet order up an instruc¬ 
tion on a modern computer and ask your 
vendor how long it will take to execute. 
Averages, even if you can compute 
them, aren’t sufficient. If I’m going to 
connect the computer to reality, I have to 
know how long this particular instance 
of the instruction will take. There is a 
reason why so few bridges are built with 
flex-straws. 

I am skeptical of trading off a few 
high-quality cycles for lots of low-quality 
ones. I think the solutions themselves 
will be less satisfactory and the resulting 
systems less efficient, and I fear our 
understanding of the problem domain 
will not grow. As Richard Hamming has 
reminded us, “The purpose of comput¬ 
ing is insight not numbers.’’ Modern, 
high-performance computer architectures 
are making numbers easier but insight 
harder. This is a “lose.” 

Scott B. Guthery 

Schlumberger Well Services 

Austin, Texas 


The Open Channel is exactly what the name Implies: a forum for the free ex¬ 
change of technical Ideas. Try to hold your contribution to one page maximum 
in the finai magazine format (about 1000 words). 

We’ii accept anything (short of iibel or obscenity) so long as It's submitted by 
a member of the Computer Society. If it’s reaiiy bizarre we may require you to 
get another member to cosponsor your item. 

Send everything to Jim Haynes, Computer Center, UC Santa Cruz, CA 95065. 
Bitnet: haynes® ucscc; Arpa: ucsccihaynes® ucbvax.berkeley.edu. 


New books from... 

8 COMPUTER 
SCIENCE 
PRESS 

DIGITAL TRANSMISSION 
SYSTEMS AND NETWORKS, 
Volume I: Principles, and 
Volume II: Applications, 

Michael J. Miller and 
Syed V. Ahamed 

This two-voiume work to be published 
early 1987 emphasizes engineering 
aspects of integrated communications 
systems for telephony, television, data, 
and other services. Available Spring 
1987; Volume I: 0-88175-094-8, $50.00; Voi- 
II, 0-88175-176-6, $50.00. 

LOCAL AREA AND MULTIPLE 
ACCESS NETWORKS, 

Raymond PIckholtz, Editor 

This outstanding volume covers the 
subject of Local Area Networks (LAN), 
Topics by well-known experts in the 
field include efficiency, congestion con¬ 
trol, performance evaluation, routing 
schemes, flow control, and more. 

S, 0-88175-143-X, 291 pages, $50.00. 

CURRENT ADVANCES IN 
DISTRIBUTED COMPUTING AND 
COMMUNICATIONS, 

Yechlam Yemlnl, Editor 

Recognized experts on state of the art 
research have contributed chapters to 
this excellent text. The book is divided 
into two sections: the first covers re¬ 
search on performance analysis of dis¬ 
tributed systems; the second deals with 
distributed processes and their com¬ 
munications, parallel systems, and VLSI 
systems. ^1987, 0-88175-128-6, 377 pages, 
$49.95. 

Z80 ASSEMBLY LANGUAGE 
PROGRAMMING 

Based on the AMS Tutorial Program 
Ivan Tomek and Peter W. Steele 

This book, and the diskette available 
for it, is an excellent tool for those who 
want to learn assembly language pro¬ 
gramming on an 8-bit computer that 
uses the Z80 processor and the CP/M 
operating system. Available Spring 1987, 
0-88175-146-4, price not yet set. 


Complimentary examination copies of college 
texts are available with a written request on 
school letterhead. Please identify course name 
and number, estimated course enrollment, and 
current text being used. 


'clers from individuals must be prepaid, f 
e subject to change without notice. Postage 
mdling is $2.50 for the first book, $l.5t 
ch additional title. State and local taxes a, 

COMPUTER SCIENCE PRESS. INC. 
1803 Rnurch Blvd.. OepL C187 
Roekvlllt. MO 2O8S0 
(301) ZS1-90S0 
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UPDATE 


News from the lEEE-CS Committee on Public Policy 

New law protects privacy of electronic communications 

Jerry P Jennings, Chair, Subcommittee on Security and Privacy 


The Electronic Communications 
Privacy Act, which is intended to pre¬ 
vent eavesdropping on electronic com¬ 
munications, was signed into law on 
October 21, 1986. The act will protect 
the privacy of electronic communica¬ 
tions, including computer-to-computer 
communications, electronic mail, remote 
computing services, and even cellular car 
phones. Up to $10,000 fines can be 
imposed. 

The content and progress of this 
legislation has been an active area of 
concern to the Security and Privacy 
Subcommittee of the IEEE Computer 
Society’s Committee on Public Policy. 
The subcommittee places special em¬ 
phasis on impact studies and US 
legislative activity and develops positions 
regarding issues of significance to the 
Computer Society and its members. 

The Electronic Communications 
Privacy Act was introduced by Senators 
Charles Mathias (R-Md) and Patrick 
Leahy (D-Vt) as Senate Bill S.1167. The 
House version, H.R. 4952, was authored 
by Rep. Robert Kastenmeier (D-Wis). 
The bill was passed by voice vote in the 
Senate on October 1, by the House the 
next day, and was signed into law three 
weeks later. Copies of the bill may be ob¬ 
tained by writing to Heidi James, IEEE 
Washington Office, 1111 19th St., NW, 
Suite 608, Washington, DC 20036. 

Lynn W. Ellis, chairman of the IEEE 
TAB/USAB Committee on Communica¬ 
tions and Information Policy, testified 
regarding the proposed legislation. He 
urged, in particular, that the technologi¬ 
cally restricitve wording of the bill be 
changed so as not to interfere with the 
rapid deployment of new technology 
when it is invented. The issues on which 
he testified were resolved and incor¬ 
porated in the final bill. 

The bill was endorsed by most of the 
providers of electronic mail and associ¬ 
ations such as the E-Mail Association, 
GTE-TelNet, and ADAPSO. It was also 
strongly endorsed by the American Civil 
Liberties Union, which recommended 
that efforts be made to ensure the pro¬ 
tection of new electronic communica¬ 
tions without stifling technical or social 
innovation or inhibiting the free flow of 


information. The ACLU is mostly in¬ 
terested in the protection of data and 
other forms of nonpublic electronic com¬ 
munications while in transit or held by a 
third party and any backup involved in 
the transmission. 

The Justice Department, on the other 
hand, took issue with the proposed 
legislation on grounds that it would 
hamper law enforcement in a serious 
way. A Justice Department spokesman 
stated that Title III, the Omnibus Crime 
Control Act, works well and provides an 
appropriate balance between citizens’ 
rights to privacy and law enforcement 
and societal interests in preventing crime 
and apprehending criminals. But he also 
admitted that Title III should be 
revalidated periodically for required re¬ 
visions as technology advances. 

This author believes that a well-written 
law was needed to punish wrong-doers 
who access private communications for 
illegal gain. But the law would only 
apply after the fact and after the damage 
has been done. Existing laws to prevent 
the use of information obtained in illegal 
wiretaps, or by tampering with the US 
mail, do apply after the fact—when 
proof of the illegal use of the private 
information so obtained is available. 

Any person or enterprise that wishes 
to protect its private communications 
can do so electronically right now. An 
enterprise protects its paper communica¬ 
tions by keeping them under lock and 
key and its verbal dealings by keeping 
them behind closed doors. It could pro¬ 
tect its telephone conversations through 
scrambling and its digital information 
through encryption. (Members interested 
in encipherment/decipherment devices 
for personal computers are urged to refer 
to the April 1985 issue of Infosystems, 
the magazine for information systems 
management, published by the Hitch¬ 
cock Publishing Company, Wheaton, IL 
60188.) 

The COPP Subcommittee on Security 
and Privacy will now be working on 
further position papers for endorsement 
by the Computer Society’s Board of 
Governors. If you are interested in join¬ 
ing the subcommittee, please contact the 
COPP secretary or the subcommittee 


chair at the following addresses: Paul 
Davis, 41 W. Huron St., Jackson, OH 
45640: Jerry P. Jennings, Laddis Corp. 
PO Box 2008, Dearborn, MI 48123. 


Dictionary project 
publishes glossary 

The first of a series of glossaries of 
computing terminology has been ap¬ 
proved and published by the IEEE Stan¬ 
dards Board. The standard, ANSI/IEEE 
Std 1084-1986, IEEE Standard Glossary 
of Mathematics of Computing Terminol¬ 
ogy, may be purchased for $8 US, plus 
handling, from three sources: 

IEEE Computer Society Press, 
Worldway Postal Center, Los Angeles, 
CA 90080, (order number 970; phone 
(800) CS-BOOKS or (714) 821-8380); 
IEEE Service Center, 445 Hoes Lane, 
Piscataway, NJ 08854 (phone (201) 
981-0060); or IEEE Computer Society, 

2 Avenue de la Tanche, B1160 Brussels, 
Belgium (phone 32.2660.11.43). 

This is one of a series of incremental 
dictionary standards that will encompass 
the entire computer field. 

P1085, Computer Applications 
Terminology, is completing balloting and 
is scheduled for Standards Board ap¬ 
proval this month. 

P1088, Computing Environment 
Terminology, and PI086, Theory of 
Computing Terminology, are scheduled 
for ballot in the spring. 

P1087, Computer Hardware Termi¬ 
nology, and PI089, Computing Method¬ 
ologies Terminology, are scheduled for 
ballot in the fall. 

The complete P610 standard. Com¬ 
puter Dictionary, includes terms from all 
the above and is scheduled for ballot in 
the spring of 1988, together with the 
revision of ANSI/IEEE 729-1983, IEEE 
Standard Glossary of Software Engineer¬ 
ing Terminology. 

The sponsor of this effort is the IEEE 
Computer Society Standards Coordi¬ 
nating Committee. Volunteers are 
welcome and should contact Jane 
Radatz, Logicon, Inc., PO Box 85158, 
San Diego, CA 92138: (619) 455-1330. 
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KEYNOTERS. H. Ross Perot (above left), an entrepreneur who founded Dallas- 
based Electronic Data Systems with $1000 after quitting his job as an IBM salesman 
in 1962, gave the FJCC industrial keynote address Tuesday, November 4. Perot sold 
EDS to General Motors two years ago but continued as chairman of the computer 
services company until shortly after FJCC. (The GM Board of Directors’ decision to 
sever ties with Perot and buy back his stock was announced December 1.) Wednes¬ 
day’s plenary session featured two keynote speakers: C. Gordon Bell (above right), 
assistant director for the Computer and Information Science and Engineering Direc¬ 
torate of the Nationai Science Foundation, and Kenneth G. Wilson (not shown), 
director of Cornell University’s supercomputer center. 


TUTORIALS. The FJCC Professional 
Education Program consisted of 20 
preconference tutorials held Sunday and 
Monday, November 2-3. Above, John 
D. McGregor of Murray State University 
coaches Bob Hagen of EDS toward com¬ 
pletion of a hands-on exercise using tech¬ 
niques just described in “Building Expert 
Systems.’’ McGregor’s tutorial was one 
of nine on artificial intelligence. 


ACM and lEEE-CS 
launch Fall Joint 
Computer Conference 

Two professional computing societies, 
the Association for Computing 
Machinery and the IEEE Computer 
Society, have now combined their 
national fall conferences into one joint 
meeting—the Fall Joint Computer 
Conference. It replaces the ACM 
National Conference and the Computer 
Society’s Compcon Fall. 

FJCC took place November 2-6 at the 
Dallas, Texas, Infomart, which will also 
be the site for the second meeting in the 
fall of 1987. More than 3000 people 
attended all or part of the five-day 1986 
event, which featured two days of 
tutorials, three days of technical sessions, 
and exhibits. 

On Sunday and Monday, November 2 
and 3, tutorials were offered in six areas: 
artificial intelligence, computer design, 
modeling and measurement, computer 
engineering, programming systems, and 
software engineering. 

The three-day technical program, 
which began the next day, featured 74 
sessions in nine arenas: education, soft¬ 
ware systems, artificial intelligence, 
supercomputing, algorithms, modeling 
and measurement, computer design, 
international development, and 
operating systems and databases. 


RECEPTION. Fall Joint Computer Conference registrants previewed the exhibit area 
and the Dallas Infomart facility Monday evening, November 3. Among those attending 
the Conference and Exhibitors Reception were (above, left to right) Stanley Winkler, 
conference chair; Ted Landberg, member of the Public Relations Media Committee; 
and J.T. Cain, acting president of the Computer Society. ACM and the Computer 
Society cosponsored FJCC, which Winkler termed “the best computer conference of 
the decade.” His personal criterion for the best conference—the one at which he’s 
having the most fun—was met, Winkler said, because he “picked people who made it 
happen.” Those people included Harold Stone, who was responsible for the technical 
sessions, and Toni Shetler, who chaired the Professional Education Program. 


The breadth and depth of the FJCC 
program, aecording to Conference Chair 
Stanley Winkler, probably exceeded that 
of any conference held in the last 
decade. He did, however, note that the 
resulting 1248-page conference 
proceedings made “heavy reading.” 
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ACM holds contests, presents awards during FJCC 


ACM conducted two computer chess 
tournaments and a student programming 
contest during the Fall Joint Computer 
Conference, cosponsored with the IEEE 
Computer Society and held November 
2-6 in Dallas, Texas. The association also 
presented five major awards at the 
Thursday, November 6, plenary session. 

Awards. John Hopcroft of Cornell 
University and Robert Tarjan of Prince¬ 
ton University received ACM’s most 
prestigious award—the Turing Award— 
for their individual and joint contribu¬ 
tions in algorithms. The award is named 
after A.M. Turing, an Englishman who 
created some of the mathematical foun¬ 
dations of computer science in the 
1930’s, and is accompanied by a $2000 
prize. 

The ACM Distinguished Service 
Award was presented posthumously to 
Clair Maple for “a lifetime of innovative 
contributions and distinguished leader¬ 
ship in the use of computers in higher 
education.” Maple served for many 
years as director of the Computer Center 
at Iowa State University. 

Herbert Maisel of Georgetown Univer¬ 
sity received ACM’s Outstanding Contri¬ 
bution Award. Maisel was cited in parti¬ 
cular for his service as chair of the Inter¬ 
society Liaison Committee. 

Donald E. Knuth of Stanford Univer¬ 
sity received the Software System Award 
for the “design and implementation of 
TEX, an innovative tool for the com¬ 
puter composition of documents of high 
typographical quality.” 

The Grace Murray Hopper Award, 
which honors the outstanding young 
computer professional of the year, was 
presented to William N. Joy of Sun 
Microsystems for his work on the Berke¬ 
ley Unix operating system. The award re¬ 
cipient must have been 30 years of age or 
less at the time of the qualifying con¬ 
tribution. A prize of $1000 is supplied by 
the Sperry Corporation. 

Chess. The FJCC hosted two comput¬ 
er chess tournaments and crowned two 
champions. Belle, a program developed 
at Bell Laboratories by Ken Thompson 
and Joe Condon, won the ACM’s 17th 
North American Computer Chess Cham¬ 
pionship. Mephisto, a program devel¬ 
oped for Hegener and Glaser AG by 
Richard Lang, won the Sixth World 
Microcomputer Chess Championship. 

Belle won all five of its games to 
recapture a title that it had won several 
times in the early 1980’s. The program 
ran on a PDF 11/23 and searched chess 
trees with as many as 30,000,000 posi¬ 
tions per move. Finishing in second place 


was Lachex, which ran on a Cray XMP 
and was developed by Burt Wendroff at 
Los Alamos National Laboratory. 

In the microcomputer championship, 
14 programs competed for seven rounds. 
Mephisto won all but one of its games. 

In second place was Fidelity Interna¬ 
tional’s product. Fidelity 2533, which 
defeated a grand master in tournament 
play earlier in the year. 

Programming. Forty-two teams of stu¬ 
dent programmers from 33 colleges and 
universities throughout Louisiana, 
Arkansas, Oklahoma, and Texas com¬ 
peted in the 17th Annual ACM South 
Central Region Scholastic Programming 
Contest. The winners, teams from the 
University of Texas at San Antonio and 
from Rice University, will go on to the 
international competition held during the 
ACM Computer Science Conference, 
February 17-19 in St. Louis. 

The contest challenged teams to solve 
five programming problems in a four 
and one-half hour period. Teams were 
then ranked on the basis of number of 
problems solved, time of completion, 
and number of tries. 

According to the contest director, Tom 
Nute of Texas Christian University, 



STATUS REPORT. ACM President 
Paul Abrahams delivered his state-of- 
the-ACM address during the Thursday, 
November 6, FJCC plenary session. He 
cited the Special Interest Groups as one 
of the association’s strengths and out¬ 
lined plans for budget reorganization 
and membership growth. 

teams typically go to great lengths to de¬ 
velop strategies to deal not only with the 
problems but with such questions as 
“Who will work on which problems, 
when do you give up and move on to 
another problem, and how do you take 
advantage of contest procedure?” 



PROGRAMMING CONTEST. “We’re winning,” Thane Mitchell replied when 
asked—several hours before the competition ended—how his team was faring in 
ACM’s South Central Region Scholastic Programming Contest. Confidence and 
team strategy paid off. Thane (watching from the background in the photo above) 
and teammates (foreground, left to right) Ian Mitchell, Bruce Tomlin, and Richard 
Lial did, indeed, win. The University of Texas at San Antonio team completed four 
of five problems in a total time of six hours and 18 minutes, bettering the second- 
place Rice University team by almost two hours. Part of their winning strategy—an 
important element according to the contest director, Tom Nute—was to allow only 
the two fastest typists on the terminal and to have one of them typing at all times. 
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AFIPS seeks nominees for three 1987 awards 


Nominations are open for three 
awards to be presented by the American 
Federation of Information Processing 
Societies—the Harry Goode Memorial 
Award, the Education Award, and the 
AFIPS-Fortnne Magazine Product-of- 
the-Year Awards. 

The Harry Goode Memorial Award is 
given each year in memory of Harry H. 
Goode, a pioneer and leader in the field 
of systems engineering. It honors either a 
single contribution of outstanding sig¬ 
nificance in theory, design, or techniques 
in information processing, or an 
accumulation of contributions that 
represent an outstanding contribution. 
The award provides a medal, a certifi¬ 
cate, and a $2000 honorarium. 

The Education Award honors contri¬ 
butions through publications, innovative 
teaching, curriculum development, 
and/or leadership. It consists of a certifi¬ 
cate and a $1000 honorarium. 

The Product-of-the-Year Awards, 
established in 1985, recognize out¬ 
standing products in the computer field. 
One award and up to two meritorious 
mentions may be given in each of three 
categories: hardware, software, and sys¬ 


tems. Nominated products must be 
innovative, have a potentially significant 
impact on the computer industry, and be 
commercially available within the United 
States. 

To submit a nomination, request and 
complete the appropriate form and send 
it to Stanley Winkler, c/o AFIPS, 1899 
Preston White Dr., Reston, VA 22091. 
Nominations must arrive by February 1, 
1987, except for product nominations, 
which are due March 15, 1987. 


Center offers 
supercomputer time 

A new supercomputer facility has been 
completed in Toronto, Canada. The 
facility houses a Cyber 205 supercom¬ 
puter, and the machine in underutilized. 
To help offset operating costs, MEM 
Marketing Services is offering computer 
time to outside scientists and engineers. 
Researchers who have a need for super¬ 
computer time may call Mike Madryga 
at (416) 475-7097 to discuss their needs. 


Nominations open for Eckert-Mauchly Award 


Nominations are now being solicited 
for the Eckert-Mauchly Award. The 
joint ACM-IEEE Computer Society 
award is presented annually to a person 
or persons for technical contributions to 
computer and digital systems architec¬ 
ture. 

The 1987 award, which carries an 
honorarium of $1000, will be presented 
at the 14th International Symposium on 
Computer Architecture, June 3-6, 1987, 
in Pittsburgh. 


Each nomination should describe in 
200-500 words the candidate’s contri¬ 
butions and be accompanied, where 
possible, by the names, addresses, and 
telephone numbers of others qualified to 
supply further information about the 
candidate. 

Nominations should be submitted no 
later than March 15, 1987, to John 
Riganati, Supercomputing Research 
Center, 4380 Forbes Blvd., Lanham, 

MD 20706. 



BUSCON/87-West 

The Bus/Board Users Show & Conference 

January 19-21,1987 

Los Angeles Airport Hilton Hotel 

Los Angeles, California 

DISCOVER: 

• Which vendors are winning the race 

• What products are avaiiabie 

• New ways to soive your technicai needs 

• How to keep you and your company up- 
to-date in this rapidiy chanoing fieid 

• Aii about new—and special—Bus 
architectures 

SEE: Hands-on exhibits with new 
Bus/Board products 

LEARN: Through tutorial seminars 
and technical sessions on Emerging 
Bus Technologies and Features, plus 
new applications ideas for your 
current projects 

For more Information, write BIN Weber 

BUSCON, 17100 Noiwalk Blvd., Ste. 116, 

Cerritos, CA 90701-2750 
or call BIN at (213) 402-1610 
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NEW PRODUCTS 


NEC offers laptop 


Micro CAD/CAM has CAD for the Macintosh 


NEC Home Electronics has announced an 
IBM PC-compatible portable PC called the 
Multispeed. The NEC laptop operates at both 
4.77 MHz and 9.54 MHz. It uses the MS- 
DOS 3.2 operating system, but is also 
compatible with earlier versions. 

The Multispeed features NEC’s V-30 pro¬ 
prietary microprocessor chip, two 3.5-inch 
floppy disk drives, a detachable screen with 
an 80-character-by-25-line display, 640K bytes 
of RAM, 512K bytes of ROM, built-in firm¬ 
ware with windowing, and a separate numeric 
keypad. The portable contains parallel, serial 
232-C, and RGB video interface ports, plus 
an external floppy disk controller port. 

Options include a 300/1200-baud Hayes- 
compatible modem, a PC data transfer pack¬ 
age, and a carrying case. 

The Multispeed measures 13.6 by 12 by 3 
inches and weighs under 12 pounds. It costs 
$1995. For more information, contact NEC 
Home Electronics, Computer Products Div., 
1255 Michael Dr., Wood Dale, IL 
60191-1094; (312)860-9500. 


Micro CAD/CAM offers a computer-aided 
design software program for the Apple Mac¬ 
intosh called MGMS Professional CAD for 
Mac. (MGMS stands for Micro Graphic 
Manufacturing Station.) 

The program offers cartesian, absolute, in¬ 
cremental, and polar measuring systems, and 
English or Metric dimensioning accurate to 
four decimal places. (Calculations are made 
to 15 decimal places.) It stores graphics in 
PICT format and can transfer graphics to and 
from Macintosh programs. An optional 
module allows graphics to be transferred to 
and from personal and mainframe computers 
using IGES. For example, the module can 
send Macdraw graphics to an IBM PC, con¬ 
verting them into AutoCAD graphics. 

MGMS Professional CAD for Mac creates 
objects by grouping lines, arcs, and circles. 


Objects can be translated, rotated, or mirror- 
imaged. Up to 64 layers of component parts 
can be shown or hidden, grouped, or manipu¬ 
lated separately. 

Other features include a geometrical 
module, splining, scrolling, and movable 
axes. A library stores up to 50 symbols and 
drawings. The number of libraries is limited 
by disk space available. 

Output is supported by the Apple Image- 
writer I and II, Apple LaserWriter, and vari¬ 
ous size A through E pen plotters. 

MGMS Professional CAD for Mac retails 
for $799. For more information, contact 
Micro CAD/CAM, 3230 Overland Ave., 

#105, Los Angeles, CA 90034; 

(213) 376-6860. 
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New HP products expand HP Touchscreen 


Reader Service Number 40 


Datavue offers laptop 

Datavue has announced the Spark, an IBM 
PC-compatible laptop computer. The nine- 
pound laptop comes with a 3.5-inch floppy 
disk drive, 384K bytes of DRAM, a birefrin- 
gent screen, and serial, parallel, RGB, and 
composite ports. The 80C88 processor runs at 
either 4.77 or 9.54 MHz. 

Options include dual 3.5-inch floppy 
drives, an internal 300/1200-baud modem 
with two RJl 1 jacks, and EL backlit screen, 
and a 256K-byte memory board. 

The Spark costs $995. Contact Datavue, 
Portable Computer Div., One Meca Way, 
Norcross, GA 30093-2919; (404) 564-5668. 
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Intel has announced the C 386 Compiler 
and RLL 386 Relocation, Linkage, and 
Library Tools package 80386 development 
tools for IBM PC-AT and AT-compatible 
PCs running DOS 3.0 or later. The DOS tools 
can be used on stand-alone PCs, or on PCs 
linked to other PCs or to VAX and Micro- 
VAX computers through the Intel OpenNET 
network. 

The C 386 Compiler produces object code 
compatible with Intel's other 80386 lan¬ 
guages, allowing modules written in different 
languages on different hosts to be linked 
using the RLL 386 linkage utilities. 

The RLL 386 Relocation, Linkage, and Li- 


Hewlett-Packard has announced the HP 
expanded-memory board and the Microsoft 
Windows environment manager for the HP 
Touchscreen PC. The company also an¬ 
nounced for Touchscreen new versions of 
MS-DOS 3.2, Lotus 1-2-3, and upgrades for 
HP Execudesk, Memomaker, and Personal 
Card File. 

The HP expanded-memory board comes 
with 512K bytes of memory that can be in¬ 
creased in 256K-byte increments to 2M bytes 
per board. As many as four boards can be 
used simultaneously. The board costs $695 for 
512K bytes, $180 for each 256K-byte incre¬ 
ment, and $595 for the numeric coprocessor. 

The board also comes with a RAM disk 
drive that reputedly speeds the performance 
of applications software, a Save utility that 
allows users to copy RAM disk to a micro¬ 
floppy or hard disk, the HP human interface 
link to connect input devices, and a printer 


brary Tools allows system software engineers 
to design protected multiuser and multi¬ 
tasking operating systems. The package con¬ 
tains four main elements: a linker that in¬ 
tegrates program modules; a builder that 
assigns absolute addresses to files created by 
the linker; a mapper that aids debugging and 
documentation; and a librarian that creates 
and manages a library of program modules. 

The C 386 Compiler (D86C386NL) costs 
$900. The RLL 386 Relocation, Linkage, and 
Library Tools package (D86RLL386NL) costs 
$600. Contact Intel, Lit. Dept. W338, 3065 
Bowers Ave., Santa Clara, CA 95051. 
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buffer that allows one file to be edited while 
another prints. 

Microsoft Windows for Touchscreen costs 
$175. Lotus 1-2-3 costs $495; Execudesk, $95; 
MS-DOS 3.2, $85; the Memomaker upgrade, 
$85; and the Personal Card File upgrade, 
$135. 

For more information, write Inquiries 
Manager, Hewlett-Packard, 1820 Embar- 
cadero Rd., Palo Alto, CA 94303, or call 
(800) 367-4772 for the number of the nearest 
sales office. 
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C compiler applies AI 

The C86P1US from Computer Innovations 
is based on technology that applies artificial 
intelligence techniques to produce optimized 
code, according to the company. This tech¬ 
nology also reputedly allows their C compil¬ 
er to take advantage of hardware architec¬ 
tures such as Intel’s 80286 and 80386 micro¬ 
processors. 

Computer Innovations claims a 70 percent 
increase in speed of the C86Plus running the 
sieve benchmark over the current C86 version 
2.3, the company’s prior C compiler. 

The C86P1US includes ANSI C library func¬ 
tions such as register variables, structure as¬ 
signment, function prototypes, type 
modifiers, long double 80-bit floating-point, 
and enumerator data types. 

The C86P1US retails for $497. Contact 
Computer Innovations, 980 Shrewsbury Ave., 
Tinton Falls, NJ 07724; (201) 542-5920. 

Reader Service Number 45 


PC-DOS programming languages support 80386 
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Kaypro introduces 386-based supermicros 


Kaypro has announced three super¬ 
microcomputer systems based on the Intel 
80386 microprocessor. 

The Kaypro 386, Model A entry-level unit 
includes a 1.2M-byte floppy disk drive with 
512K bytes of RAM and a floppy disk and 
hard disk controller board. The Model E in¬ 
cludes a 1.2M-byte floppy disk drive, a 
40M-byte hard disk, and IM byte of RAM. 
The Model-N Network File Server comes with 
a 170, 280, or 380M-byte ESDI hard disk 
drive. All models are expandable up to 660M 
bytes of hard disk storage with 16M bytes of 
RAM. They are available with a 


New Micro has aimounced an in-circuit 
emulator for the Intel 80386, a symbolic 
debugger for MICE in-circuit emulators, an 
in-circuit emulator for Motorola 68000 and 
68010 microprocessors, and a development 
system for Intel 8086 and 8088 and NEC V20 
and V30 microprocessors. 

The MICE-32/80386 in-circuit emulator for 
the Intel 80386 can run with an IBM PC-XT, 
PC-AT, or compatible, or with a VAX or 
MicroVAX using VMS or Ultrix. The emulat¬ 
or can also operate as a stand-alone system 
with any terminal device. It features 32-bit¬ 
wide registers and a 104-bit-wide trace buffer. 
It costs $15,000. 

The MSD-3 language-structured symbolic 


monochrome, CGA, or EGA video display. 

Kaypro will also offer two optional 
5M-byte per minute, 60M-byte cartridge tape 

The Model A costs $4995. The Model E 
with 40M bytes costs $6295; with 130M bytes, 
$8595. The Model N costs $ 11,450 with 170M 
bytes; $14,950 with 280M bytes; and $19,950 
with 3SOM bytes. 

For more information, contact Kaypro, PO 
Box N, Del Mar, CA 92014; (619) 481-4300. 
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debugger supports New Micro’s MICE in- 
circuit emulators. It costs $840 running on a 
PC, $2000 running on a VAX with VMS or 
Ultrix, and $1650 running on a MicroVAX 
with VMS or Ultrix. 

The MICE-16/68000 is a 16-bit in-circuit 
emulator for the Motorola 68000 and 68010 
microprocessors. It costs $9000. 

The MICE-16/8086F is a 16-bit in-circuit 
emulator for the Intel 8086 and 8088 and 
NEC V20 and V30 microprocessors. It costs 
$9000. 

For more information, contact New Micro, 
16901 S. Western Ave., Gardena, CA 90247; 
(213) 538-5369. 
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5030 emulation for Domain 


Apollo Computer has announced the 
Domain 5080 Emulator, an IBM 5080 
graphics terminal emulation that lets users si¬ 
multaneously run both mainframe and work¬ 
station applications from the same worksta¬ 
tion display. The product combines hardware 
and software and is compatible with Apollo’s 
family of Domain workstations. 

The Domain 5080 emulates IBM 5080 
graphics terminals and the standard 5080-style 
peripherals, including keyboard, lighted- 
function program keyboard, data tablet, and 
input dials. The emulator uses graphics soft¬ 
ware to emulate 5080 graphics order codes 
and display-list functionality, and it supports 
Apollo’s graphics service routines. 

The Domain 5080 Emulator is available in 
a bundled system that includes Spectra- 
graphics DSCC, interface boards. Domain 
DSP90 gateway server, and software site 
licenses for all workstations on a network. 
Prices for local configurations range from 
$44,500 for 4 users to $54,500 for 16 users (or 
$3400 per user for a 16-user system). Remote 
configurations range from $59,900 for 4 users 
to $69,900 for 16 users. Upgrades for existing 
DSCCs are available. 

For more information, contact Apollo 
Computer, 330 Billerica Rd., Chelmsford, 

MA 01824; (617) 256-6600. 
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New Micro expands product line 


DISTRIBUTED INFORMATION SYSTEMS: 
NETWORKS AND APPLICATIONS 

a Workshop Sponsoretd by the 

IEEE Information Theory, Computer and Communications 
Washington D.C./Northern Virginia Chapters 
On Monday, February 23,1987 8:00 ■ 6:00 



’ Distributed Aigorithms 
Prof. Robert Gallager, Massachusetts institute 
of Technoiogy 

’ Protocols for Key Management and Authentication 
Prof. Raymond Pickholtz, George Washington University 
' Information Infrastructures 
Dr. Vinton Cerf, Corporation for National Research 
Initiatives 


’ Recent Developments in the ISO Encryption 
Standard 

Dr. Dennis Branstad, National Bureau of Standards 
’ Networking with Radio 

Prof. Anthony Ephermides, University of Maryland 
' Interoperability and Distributed Systems: 

A Database Perspective 

Mr. Steve Oxman, OXKO Corporation 


Mail check along with compieted registration form to: 

IEEE INFORMATION THEORY GROUP ■ WORKSHOP 
12498 Fan Leaf Court 
Fairfax, Virginia 22033 

Registration confirmation, map and directions wiil be sent to those 
who register before February 9, 1987. Registration after February 9, 
1987 wiii be at the door and wili cost an additionai $10.00. 


REGISTRATION FORM; 

Yes! Please register me in the Workshop on Distributed informa¬ 
tion Systems to be heid on February 23, 1987 in Washington D.C.. 
Enclosed is a check for (piease check one box) 

Preregistration 

Prior to Membership 

Feb. 9,1987 Number 

IEEE Member $60.00 □ _ 

IEEE Student Member $45.00 □ _ 

Nonmembers $75.00 □ 


Registration fee inciudes coffee and donuts, a light iunch and 
afternoon refreshments. 

For further information contact Dave McDysan (703) 734-2263, or Dr. 
Bijan Jabbari (301) 428-5660. 

Workshop wiii be heid at the George Washington University, 
Washington D.C. Marvin Center Continentai Baliroom on the corner 
of 21st and H Streets. 


made payable to: IEEE Information Theory Group. 

NAME _ 

AFFILIATION _ 

ADDRESS_ 

CITY_STATE_ZIP CODE_ 

TELEPHONE#_ 















Tops Print links IBM PCs to 
Apple LaserWriters 

Centram Systems West has announced 
Tops Print, a software program that enables 
IBM PCs and compatibles to print directly to 
shared Apple LaserWriters on an Appletalk 
network. 

According to the company, the program 
captures the character stream resulting from a 
PC user issuing a standard print command 
from within an application and translates the 
characters into Postscript, the page descrip¬ 
tion language used by the LaserWriter. The 
file is then automatically sent to the first 
available LaserWriter on the network and 
printed. A spooler feature lets the user 
continue working while waiting for the print 
job to finish. 

The software can also print to an Appletalk 
Imagewriter II, a local printer, or a Post- 
script-driven typesetter, such as the Linotronic. 

Tops Print costs $189 per PC. For more in¬ 
formation, contact Centram, 2650 Ninth St., 
Berkeley, CA 94710; (415) 549-5900. 
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Expert system for Wang VS 

Coyne Kalajian has announced ExpertR, 
an expert system shell for the Wang VS. 
ExpertR allows users to develop rule-based 
interactive expert systems by selecting from 
menus and filling in the blanks to create 
expert programs. It permits integration of 
images and text, so that the expert system can 
ask the user questions that require a visual 
image to understand. 

ExpertR retails for $25,000. For more 
information, contact Coyne Kalajian, 1701 N. 
Fort Myer Dr., Arlington, VA 22209; 

(703) 522-7026. 
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Imaging for the lab 

Microtex has announced the Microtex 8700 
Scientific Imaging System for the laboratory 
environment. The product includes digital 
imaging acquisition, processing, and analysis 
techniques to permit exploration of ex¬ 
perimental regimes. It has 12 bits per pixel 
resolution. 

The systems feature a turnkey workstation 
that includes imaging hardware and image 
rendering software. Each Microtex 8700 in¬ 
cludes a MicroVAX II computer. Users may 
share data and resources with other DEC and 
IBM computers using Ethernet links. 

Prices range from about $110,000 to 
$130,000 depending on configuration. For 
more information, contact Microtex, 80 
Trowbridge St., Cambridge, MA 02138; 

(617) 491-2874. 
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3-D CAD/CAM system costs around $15,000 


Micro Engineering Solutions has an¬ 
nounced Solution 3000, an IBM PC-based, 
three-dimensional computer-aided design and 
manufacturing system. A complete turnkey 
system, including hardware, software, train¬ 
ing, and warranty, costs under $15,000. Soft¬ 
ware can be purchased separately for ap¬ 
proved configurations. 

Solution 3000 targets design and manufac¬ 
turing engineers who need features such as 
product design and surface modeling; fixture 
and gage design; die design; wood model pro¬ 
totype production, numerical control machin¬ 
ing; coordinate measuring; and detailing and 

The wire-frame surfaced modeling system 
allows users to observe their models with up 
to four different views simultaneously. 

Autodesk updates AutoCAD, 

Autodesk has announced version 2.6 of 
AutoCAD, for delivery in March of 1987. 
According to the company, the new version 
extends AutoCAD’s three-dimensional 
capabilities, offers associative dimensioning, 
and extends AutoLisp to allow access to the 
symbol tables. The update will retail for 
$2850. 

Available in the first quarter is AutoShade, 
a full-color shaded rendering package that 
allows users to make AutoCAD drawings into 
solid images showing color, perspective, and 
surface shapes and features. The program re- 


Geometry added or edited in any viewport 
will be reflected in all of them. 

On-screen icons, pop-up menus, and help 
screens walk first-time users through the pro¬ 
cess, while more experienced users can 
employ programmable tablet menus, pro¬ 
grammable keys and icons, and user-defined 
macros. 

Bidirectional interfaces permit communica¬ 
tion with other CAD/CAM systems. Avail¬ 
able formats include IGES and DFX. 

For more information, contact Micro 
Engineering Solutions, 32969 Hamilton 
Court, Farmington Hills, MI 48018; 

(313) 553-8470. 
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adds AutoShade 

quires AutoCAD. It will retail for $500. 

Autodesk has also announced AutoCAD 
AEC Mechanical, which customizes Auto¬ 
CAD for mechanical engineers designing 
building systems. The program features a 
graphic interface to duct analysis software, 
plus a library of industry-standard symbols. 
AutoCAD AEC Mechanical will be available 
in the first quarter for $500. 

For more information, contact Autodesk, 
2320 Marinship Way, Sausalito, CA 94965; 
(415)331-0356. 
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EXCLUSIVE TIME-AND 
MONEY-SAVING FEATURES: 

■ A complete. 96-page catalog for more 
than 2000 products-many available 
only from Inmac. 

■ Easy-to-use: clear, comprehensive 
descriptions; four-color photos of prod¬ 
ucts in use; invaluable helpful hints. 

■ Convenient comparative shopping 
guides-by price, feature and quantity. 

■ Special sections on new products, 
CAD/CAM printer and plotter supplies, 
and the industry’s most complete 
cable guide. 

■ Same-day shipping, 45-day trial, 
minimum 1-year guarantee, 10- 
year history of satisfied customers! 

CALL TOLL-FREE 
1-800-547-5444 
TODAY! 

Or complete and return the 
coupon below. 


Simply mail your 
completed coupon to: 

inmaa^ 

Catalog Department 
2465 Augustine Drive 
Santa Clara, CA 95054 

Or call 

1-800-547-5444 


Company 



Address 



City 

State 

Zip 

Phone( ) 
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Borland’s Eureka solves complex problems 


Borland International’s Scientific and 
Engineering Software Division has announced 
Eureka: The Solver, a second-generation soft¬ 
ware productivity tool for IBM PCs. The 
product is designed to solve complex prob¬ 
lems, generate tables and plots, and perform 
what-if analysis. 

The user writes an equation, sets options, 
and instructs the software to solve the prob¬ 
lem. The program can also evaluate and 
display the accuracy of the solution. Equa¬ 
tions, solutions, and evaluations are accessible 
through separate windows on the screen. 
According to the company. Eureka supports 
the 8087 math coprocessor. 

Eureka solves equations directly or 
through the iterative method of successive 


Adra Systems has announced the Adra 
3000 CADD System. According to the com¬ 
pany, the system is a multifunctional, expand¬ 
able, industry-standard CADD system for 
mechanical and architectural design and 
drafting applications. The color system costs 
$18,750, while the monochrome system costs 
$14,750. 

An optional 20M-byte hard disk costs 
$1000, while a lOOM-byte hard disk with in¬ 
ternal 45M-byte cartridge tape drive costs 


Pyramid Technology has announced the 
Pyramid Connection, a group of products 
that integrates IBM PCs and compatibles, 
Apple Macintoshes, and Sun Microsystem 
workstations into a network for 30 or more 
machines. 

The products include: an Appletalk/ 
Ethernet gateway. Kinetics’ Fastpath; 
Dualport OSx, which implements Appletalk 
protocols within the OSx kernel; an Appletalk 
multiwindow terminal. Kinetics’ K-term; 
Centram’s Tops for Unix, which provides file 
access to Macintosh and IBM PC-compatible 
computers from the Unix host; Centram’s 
Tops for the Macintosh, a distributed file sys- 


Harris Computer Systems Division has an¬ 
nounced a compute server and two engi¬ 
neering workstations. 

The Multiple Application Compute Server 
(MACS) connects with other computer sys¬ 
tems through an Ethernet network for pro¬ 
cessing of engineering data. It supports the 
Network File System. 

The MACS reputedly operates at 7.5 mega- 
Whetstones, has 16 32-bit registers, cycles in 
100 ns, offers 4 gigabytes of virtual memory 
and 17 gigabytes of disk space, and transfers 
data at a rate of 80M bytes per second. 

A standard MACS configuration, priced at 
$285,200, includes 8M bytes of memory, a 
330M-byte disk, Ethernet, and NFS. A con¬ 
figuration with 16M bytes of memory costs 
$309,200. 


approximation. Problems can be solved for 
simple or complex variables on both sides of 
the equation, with up to 20 equations solved 
at a time. The program also solves minimiza¬ 
tion and maximization problems with or 
without constraints. 

Eureka: The Solver requires an IBM or 
compatible PC with PC-DOS (MS-DOS) 2.0 
or later. It is compatible with CGA, and Her¬ 
cules and compatible graphics boards. The 
program is not copy protected. It costs 
$99.95, with delivery expected during the first 
quarter. 

For more information, contact Borland In¬ 
ternational, 4585 Scotts Valley Dr., CA, 
95066; (408) 438-8400. 
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$5000. The system comes with 4M bytes of 
memory that can be upgraded in 4M-byte in¬ 
crements costing $3250 each up to 12M bytes. 

At the same time, Adra announced the 
first-quarter availability of Unix System V 
($1250), MS-DOS, Ethernet, Tektronix, and 
an IBM PC-AT Coprocessor ($2000). 

Contact Adra Systems, 59 Technology Dr., 
Lowell, MA 01851; (617) 937-3700. 
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tern for the Macintosh; Centram’s Tops for 
the IBM PC; Pyramid’s Network File System; 
and PC-NFS, a distributed file system for 
IBM PCs and compatibles. 

Two basic systems, the 98xe and 98x, are 
available. Prices start at more than $161,000 
for a 98xe configured for PC or Macintosh 
networking, and around $245,000 for the 98x 
configured for PC or Macintosh networking. 
For more information, contact Pyramid 
Technology, 1295 Charleston Rd., PO Box 
7295, Mountain View, CA 94039-7295; 

(415) 965-7200. 
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The Harris Station 240 and 260 engineering 
workstations can be connected to the MACS 
or used as multiuser systems for applications 
requiring high-resolution graphics. They are 
32-bit systems based on Unix and the 
Motorola MC68020 microprocessor with a 
built-in 68881 coprocessor. They reputedly 
operate at up to 3.6 MIPS per processor. 

Both workstations include a hi-res, 19-inch, 
color graphics subsystem capable of display¬ 
ing 1024 colors from a palette of over 16 
million. The HS-260 provides up to 28 bit 
planes of graphics memory. 

The HS-240 costs $49,900 and the HS-260, 
$84,900. For more information, contact Har¬ 
ris, Computer Systems Div., 2101 W. Cypress 
Creek Rd., Ft. Lauderdale, FL 33309-1892. 
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NEW LITERATURE 


Fifth Generation Computers. Richard Miller’s 
book analyzes the objectives, research ac¬ 
tivities, and potential impact of the eight 
leading fifth generation projects. The Fair¬ 
mont Press, Inc., 700 Indian Trail, Lilburn, 
GA 30247; (404) 925-9388; $45. 


1987 Sourcebook. Annual publication of the 
North American Telecommunications Associ¬ 
ation, listing voice/data telecom products, 
vendors of telecommunications systems, and 
network-building firms. Also contains articles 
concerning telecom management, new tax 
policies, and application-feasible technologies. 
NATA, 2000 M St., N.W., Ste. 550, Washing¬ 
ton, DC 20036; (202) 296-9800; $45. 


EDUCOM guidebook. This association of 
educational institutions interested in informa¬ 
tion technology has announced publication of 
its first annual Guide to Corporate Asso¬ 
ciates. The guide includes profiles of 59 
EDUCOM-affiliated companies, describing 
their products, programs, and services. 
EDUCOM, PO Box 364, Carter and Rosedale 
Roads, Princeton, NJ 08540; (609) 734-1915; 
$14.95. 


Second review of PHIGS standard. The Ac¬ 
credited Standards Committee on Informa¬ 
tion Processing is again releasing for review 
and comment American National Standard 
X3.144-198X, which specifies a set of func¬ 
tions for computer graphics programming, 
the Programmer’s Hierarchical Interactive 
Graphics System—a graphics system for ap¬ 
plications producing computer-generated pic¬ 
tures on line or raster graphics output devices. 
The review period ends January 27. Global 
Engineering Documents; (800) 854-7179; $75. 


Metrabyte’s new Fall 1986 handbook. 
Describes company’s line of plug-in boards 
for data acquisition, industrial control inter¬ 
faces for PCs, and communications interfaces 
for IBMs and compatibles. Metrabyte Corp., 
440 Myles Standish Blvd., Tauton, MA 
02780; free. 


Engineering Software Report. ESR features 
surveys and articles on such topics as simula¬ 
tion, project management, forecasting and 
scheduling, and database engineering. The 
Center for Technology Management, PO Box 
470, Clarkston, GA 30021; (404) 296-2640; 
$87. 


Interface databook. National Semiconductor 
interface product line databook describes 
drivers and receivers, bus transeivers, display 
controllers, and memory and microprocessor 
support. C.M.C. Publications, 575 Sinclair 
Frontage Rd., Milpitas, CA 95035-5470; (408) 
945-1557; $9. 


Adra System’s 3000 joins CADD family 


Pyramid Connection connects PCs 


Compute server, workstations from Harris 
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.TUTORIAL WEEK. 
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ORLANDO '87 


HYATT ORLANDO 

KISSIMMEE, FLORIDA 
MARCH 16-20, 1987 


Fifteen Tutorials in 3 Tracks 
Plus a Workshop 

Attendance limited to 100 per tutorial and 24 for the workshop. SO REGISTER NOW. To receive the advance registration discount, registration 
must be postmarked no later than February 20, 1987. Requests for refunds must be received in writing by February 20, 1987. Registration 
includes Tutorial Notes and Luncheon. 


TUTORIALS/WORKSHOP COMMITTEE 



MAll TO Tutorial Week Orlando '87, CairjpuU'f S^xiery of the IEEE, 1730 Massachusetts 
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Recent 1C Announcements 


MODEL AND R S. 

FUNCTON COMPANY COMMENTS_NO. 


Bt401, Bt402, Bt403, Bt404 Brooktree Corp. 
Pipelined SRAMs 9950 Barnes Canyon Rd. 

San Diego, CA 92121 
(619) 452-7580 


82A436; 82C435 
Enhanced graphics 
controller; 
bus interface 


Chips and Technologies, Inc. 
521 Cottonwood Dr. 
Milpitas, CA 95035 
(408) 434-0600 


Application-specific IC 
(ASIC) 

video controllers 


Genoa Systems Corp. 
73 E. Trimble Rd. 
San Jose, CA 95131 
(408) 432-9090 


Designed for use as color palette RAMs in high-performance graphics 70 
systems, these four 256 x 8-bit devices feature 4-ns cycle times. The 
Bt401 (lOO’s price: $39) and Bt402 (lOO’s price: $39) offer 3 x 8-bit 
Sidecar RAMs; they are directly compatible with lOK ECL and lOOK 
ECL, respectively. The Bt403 (lOO’s price: $36) and Bt404 (lOO’s 
price: $36) are functionally equivalent to the Bt401 and Bt402, 
respectively, but do not feature Sidecar RAM. 

Fully compatible with the IBM Enhanced Graphics Adapter, the 71 

82C435 (lOO’s price, $50) offers full backward compatibility to CGA, 
Hercules, and IBM Monochrome modes. It features 640 x 480 
resolution and supports eight color planes. The 82A436 (lOO’s price, 

$15) is implemented in a 68-pin PLCC package integrating bus 
interface logic, including buffers and drivers, memory and I/O select 

Intended for OEMs. Two proprietary VLSI CMOS families are 72 

offered. The first ($30 each in OEM volumes) has the gate array chip 
designed into Genoa’s Spectrum video board products. Features 
include 132-column and 25/44 line text mode capability. The second 
($50 each in OEM volumes) has the two-chip set designed into 
Genoa’s Super EGA products. A 6845 CRTC is incorporated in the 


HADC77100A, 
HADC77100B 
A/D converters 


Honeywell, Inc. These are 8-bit, monolithic, flash A/D converters. Both versions 

Signal Processing Technologies digitize a 2-volt analog input signal, with full Nyquist frequency com- 

1150 E. Cheyenne Mountain Blvd. ponents, at a nominal rate of 150 megasamples per second. The 

Colorado Springs, CO 80906 HADC77IOOA (lOO’s price, $295) features 70 MHz full-scale 

(303) 577-3511 bandwidth and ± 'A least-significant-bit linearity; the HADC77100B 

(lOO’s price, $200) is available in ± LSB linearity. 
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HS 9372K, HS 9372J, HS Hybrid Systems Corp. 

9372TB, HS 9372SB 22 Linnell Circle/Suburban Industrial 

DACs Park 

Billerica, MA 01821 
(617) 667-8700 


These are serial input, 16-bit, current output multiplying DACs. The 
four models, with the monotonicity (over temperature) and tempera¬ 
ture range of each, are the HS 9372K, 16 bits min., 0°C to + 70°C; 
the HS 9372J, 15 bits min., O’C to +70°C; the HS 9372TB, 16 bits 
min., -55°Cto -i-125'’C; and the HS 9372SB, 15 bits min., -55“C 
to + 125“C. They are priced at $65, $48, $150, and $125, 
respectively. 
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HY51C256L, HY51256 Hyundai Electronics America 

DRAM 4^1 Great America Pkwy. 

3rd Floor 

Santa Clara, CA 94043 


Fabricated in HYCMOS technology, these 256K x 1 dynamic RAMs 75 
feature ripplemode operation. Standard access times available are 
100, 120, and 150 ns. The HY51C256L (lOOO’s price, $5) also 
features low standby current and a 32-ms extended refresh cycle. The 
HY51256 costs $3.50 (lOOO’s). 


PLHS501 Random Logic Signetics Corp. 

Unit PO Box 3409 

Programmable logic device Sunnyvale, CA 94088-3409 
(408) 991-2000 


Based on a single NAND array with internal foldback paths and 76 

supported by Signetics’ PC-based Amaze design automation soft¬ 
ware, this PLD implements logic functions utilizing DeMorgan’s 
Theorem. Available in a 52-pin PLCC, the PLHS501 costs $26.99 
(lOO’s). 


TC511000P-85 Toshiba America, Inc. 

DRAM 2692 Dow Ave. 

Tustin, CA 92680 
(714) 832-6300 


This IM-bit x 1 dynamic RAM has an access time of 85 ns. 77 

Multiplexed address inputs permit packaging in a standard 18-pin 
plastic DIP. Features include read-modify-write, CAS before RAS 
refresh, RAS-only refresh, hidden refresh, and fast page mode capa¬ 
bility. Contact a local sales office for 1987 prices. 


XC 2018 Logic Cell Array Xilinx, Inc. 
Programmable gate array 2069 Hamilton Ave. 

San Jose, CA 95125 
(408) 559-7778 


The XC 2018 LCA contains the equivalent of 1800 conventional gates 78 
on one user-programmable chip. It operates at toggle rates up to 70 
MHz and comes in an 84-pin package, or a 68-pin package with a 
pin-compatible upgrade for users of the XC 2064. The XC 2018 costs 
from $15 to $18 in production volumes. 
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Recent Microsystem Announcements 


MODEL AND 

FUNCTON_COMPANY COMMENTS 


Smartport Arnet Corporation 

Communications board 476 Woodycrest Ave. 

Nashville, TN 37210 
(615) 254-0646 


Board features four or eight RS-232 serial ports, 64K bytes of dual- 80 
ported RAM, and an Intel 80186 processor. Compatible with the 
IBM PC/AT, Compaq 386, and Intel 80386 processor computers, 
and works with Unix, Xenix, and other multiuser operating systems. 

Cost: $895 for Smart-4; $1295, Smart-8. 


QPC-5101 Qualogy 

Motherboard/graphics 2241 Lundy Avenue 

adapter/disk controller San Jose, CA 95131 

(408) 434-5200 


Combination IBM PC/XT motherboard, color graphics adapter, and 81 
floppy/Winchester controller. Has 640K bytes of RAM and of 
EPROM, on-board BIOS, a Harris *CP80C88 CMOS micro, IBM 
CGA- and monochrome-compatible graphics controller, 3.5- and 
5.25-inch floppy controller, and SCSI Winchester controller. Cost: 

$1295. 


PME 68-21,-22, and-23 
68020 VME processor 
boards 


Plessey Microsystems 
One Blue Hill Plaza 
Pearl River, NY 10965 
(914) 735-4661 


The 32-bit 68-21 features no-wait state, pre-fetch cache, and VSB 82 

interface; the 16-MHz 68-22 offers 68851 paged MMU, SCSI 
interface, and 2M-byte dual-port RAM; and the 20-MHz, 32-bit real¬ 
time 68-23 has multiprocessor capability. Cost: PME 68-21 (with 
accelerator and computer cards) $54.65; 68-22, $44.95; and 68-23, 

$16.41. 


ARCNET-PC310 
LAN controller 


Standard Microsystems Corp. 
35 Marcus Blvd. 

Hauppauge, NY 11788 
(516)273-3100 


IBM PC and compatible board features COM9026 LAN controller 83 
and COM9032 ARCNET LAN transceiver with a transmitting 
medium of 200-;i fiber-optic cable. Has a 2K-byte packet buffer 
Cost: $1295. 


All Aboard 286 IDEAssociates, Inc. 

SMT board 29 Dunham Rd., 

Billerica, MA 01821 
(617) 663-6878 


Surface mount technology board for IBM PC AT and XT 286 84 

features 128K, 4M, or 16M bytes of memory (addressable by 80286 
machines), serial and parallel ports, and IBM enhanced graphics 
adapter functions. Cost: 128K-byte memory, $995; 4M-byte memory, 

$2595; and 16M-byte memory, $12,995. 


Prose 4000 Speech Plus, Inc. 

Voice output board PO Box 7461 

Mountain View, CA 94039 
(415) 964-7023 


Text-to-speech voice module with PCB for IBM PC/XT/AT and 85 

compatibles and diskette with I/O drivers for MS DOS. RS-232 port 
and connector, on-board amplifier, volume control, and audio jack 
included. Drivers callable from Lattice C and Microsoft C, Basic, 
and assembler. Cost: $1750. 


Evercom-24 Everex Systems Inc., 

Modem card 48431 Milmont Dr. 

Fremont, CA 94538 
(415) 498-1111 


2400-baud half-card-size modem compatible with Hayes, Bell 86 

212A/103, CCITT V.22, and V.22 bis systems. Designed with 
adaptive equalization and auto dial, answer, redial, data transfer rate 
adjustment, and data-to-voice switching. Cost: $289. 


GESMPU-20 GESPAC 

Processor board 50A West Hoover Ave. 

Mesa, AZ 85202-5266 
(602) 962-5559 


Single-height 4- x 6.25-inch Eurocard has 68020 32-bit processor 87 

with operating speed of up to 5 MIPS. Equipped with four 32-pin 
sockets for up to 512K bytes of EPROM and with 256K bytes of 
CMOS RAM. Cost $1250. 


Mighty Meg 
Memory board 


Quadram 
One Quad Way 
Norcross, GA 30093 
(404) 923-6666 


0.5M-byte to 3.5M-byte extended memory board compatible with the 88 
Compaq 386 and the IBM AT and 286 XT and compatibles. Features 
SIMM technology with 256 x 9 DRAM and can be used for RAM 
disks and protected-mode operating systems. Cost: $545 for 0.5M 
bytes; $1475 for 3.5M bytes. 


MVME390A Motorola 

Color graphics interface PO Box 20912 

Phoenix AZ 85036 


VMEbus-compatible module has 1024- x 1024-pixel resolution, bit- 89 
mapped memory, and pbtel addressing. Includes interlaced operation 
option, TTL-level RGB/monochrome video, and an 384K-byte 
RAM. VMEbus slave interface has RAM access via 24- or 32-bit 
address space. Cost: $2495. 
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CALL FOR PAPERS 


Call for papers for Computer 


Computer magazine seeks articles that 
cover the state of the art and important new 
developments in computer science, 
technology, and applications. Aimed at a 
broad audience with diverse interests and 
experience. Computer usually publishes 
surveys or tutorials that facilitate the trans¬ 
fer of technology from university to in¬ 
dustry, from research to applications, and 
across specialized fields. Submit six copies 
of the manuscript, including illustrations, 
references, and authors’ biographies, to 

• Bruce Shriver 

IBM T.J. Watson Research Center 
PO Box 704 (H0-B04A) 

Yorktown Heights, NY 10598 
(914) 789-7626 
Compmail +; b.shriver 
CSnet; shriver@ibm.com 
Vnet: shriver at yktvmh 

Computer also seeks articles on topics rele¬ 
vant to upcoming special issues. Submit sbc 
copies of the manuscript directly to the 
guest editor: 


Systolic Arrays: From Concept to 
Implementation: Submit by February 
1, 1987, to Benjamin Wah, Universi¬ 
ty of Illinois at Urbana-Champaign, 
Coordinated Science Laboratory, 

1101 W. Springfield Ave., Urbana, 
IL 61801; (217) 333-3516. The issue 
is scheduled for publication in July 
1987. 

CAD-Based Robot Vision: Submit 
by February 1, 1987, to Bir Bhanu, 
MS MN65-2300, Honeywell Systems 
and Research Center, 3660 
Technology Dr., Minneapolis, MN 
55418; Arpanet, bhanu@hi-multics; 
phone, (612) 782-7676. The issue is 
scheduled for August 1987. 
Integrated Design and Programming 
Environments: A joint issue with 
IEEE Software is in the planning 
stages. Check next month for details 
on March 1, 1987, submission to the 
guest editors, Peter Henderson and 
David Notkin. 

Standards: Material is also sought 
for the “Standards” department. For 


details regarding scope and length, 
contact the department editor: Helen 
M. Wood, National Bureau of Stan¬ 
dards, B154 Technology, Gaithers¬ 
burg, MD 20899; (301) 975-3240. 

Lastly, Computer seeks special-issue pro¬ 
posals and articles in the following topic 

• optical computing, 

• electronic publishing and technology, 

• the European computer industry, 

• fabrication and packaging 
technologies, 

• noncoded information, 

• computer-integrated manufacturing, 

• technology transfer process, 

• computers in consumer electronics, 
automobiles, etc., 

• design and implementation of large- 
scale systems, and 

• engineering and scientific worksta- 

Prospective guest editors and authors 
should submit proposals and articles di¬ 
rectly to Bruce Shriver. 


ACM SIGGraph 87 (IEEE): July 27-31, 1987, 
Anaheim, California. Submit five copies of 
the manuscript (20 pages maximum) and a 
100- to 300-page abstract by January 13, 

1987, to Maureen C. Stone, Xerox PARC, 
3333 Coyote Hill Rd., Palo Alto, CA 94304. 


ASPLOS-II, Second International Conference 
on Architectural Support for Programming 
Languages and Operating Systems: October 
5-8, 1987, Palo Alto, California. Submit five 
copies of full-length papers (approximately 
5000 words) or short papers (approximately 
1000 words) by February 1, 1987, to Randy 
H. Katz, Computer Sciences Division, UC 
Berkeley, Evans Hall, Berkeley, CA 94720. 


Compsac 87: October 5-9, 1987, Tokyo. 

Papers and proposals for panel discus¬ 
sions are sought. Submit five copies of the 
full-length paper (1000 to 5000 words; include 
a 150-word abstract). Submit five copies of 
proposals for panel discussions (include 
names of proposed panelists and a 150-word 


scope statement). Materials in both categories 
must be received by February 1,1987. Send 
them to Tosiyasu L. Kunii, c/o Business 
Center for Academic Societies Japan, 
Yamazaki Bldg. 4F, 2-40-14, Hongo, 
Bunkyo-ku, Tokyo 113, Japan; phone 81 (3) 
817-5831 (authors in Asia, Australia, and 
New Zealand) or Albert K. Hawkes, Sargent 
& Lundy, Engineering Consultants, 55 E. 
Monroe, Chicago, IL 60603; (312) 269-3640 
(authors in other areas). 

IEEE Transactions on Computers; 

Papers are sought for a special issue on 
supercomputing. Submit six copies of papers 
by February 1, 1987, to H.C. Torng, School 
of Electrical Engineering, Cornell University, 
Ithaca, NY 14853-5401; (607) 255-5191. 
(Guidelines for submitting manuscripts ap¬ 
pear on the back cover of every issue of IEEE 
Transactions on Computers.) 


VII International Symposium on Protocol 
Specification, Testing, and Verification 
(IFIP): May 5-8, 1987, Zurich, Switzerland. 


Conferences that the Computer Society participates in or sponsors are indicated by the 
iEEE Computer Society iogo; other conferences of interest to our readers are also included. 
For inclusion in Call for Papers or Calendar, submit information six weeks before the month 
of publication (e.g., for the April 1987 issue, send information for receipt by Feboiary 15, 
1987) to COMPUTER, 10662 Los Vaqueros Circle, Los Alamifos, CA 90720. 


Submit four copies of the complete paper (in¬ 
cluding abstract) by February 1, 1987, to H. 
Rudin and C.H. West, IBM Zurich Research 
Lab, 8803 Ruschlikon, Switzerland; phone 41 
(1) 72-48-433. 

AAAI-87, Sixth National Conference on Ar¬ 
tificial Intelligence: July 13-17, 1987, Seattle. 
Submit six copies of the paper (4000 words 
maximum) by February 10, 1987, to 
AAAI-87, American Association for Artificial 
Intelligence, 445 Burgess Dr., Menlo Park, 

CA 94025-3496. 

11th ACM Symposium on Operating Systems 
Principles: November 9-11, 1987, Austin, 
Texas. Submit 12 copies of the paper (5000 
words maximum) by February 16, 1987, to 
Alfred Spector, Dept, of Computer Science, 
Carnegie Mellon University, Pittsburgh, PA 
15213. 

ICCD-87, IEEE International Con- 
vS? ference on Computer Design: VLSI in 
Computers and Processors: October 5-8, 

1987, Rye Brook, New York. Submit three 
copies of a 1000-word summary by February 
16, 1987, to Prathima Agrawal, AT&T Bell 
Laboratories, 600 Mountain Rd., Room 
3D-480, Murray Hill, NJ 07974; (201) 
582-6943. 

1987 Workshop on Visual Languages: 

August 19-21, 1987, Linkoping, 

Sweden. Submit three copies of paper (5000 
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words maximum) by February 20, 1987, to 
Erland Jungert, FFV Elektronik AB, Agatan 
29, S-582 22 Linkoping, Sweden. 

Third Aerospace Computer Security Con¬ 
ference: Applying Technology to Systems 
(AIAA, American Society for Industrial 
Security): December 8-11, 1987, Orlando, 
Florida. Technical papers, ideas for panel 
discussions, and proposals for tutorials are 
sought. Unclassified preliminary materials 
should be sent by February 28, 1987. Pro¬ 
posals for papers and panel discussions 
should be sent to Stephen Walker, Trusted In¬ 
formation Systems, Inc., PO Box 45, Glen- 
wood, MD 21738. Submit proposals for 
tutorials to J. Chris Perry, Mitre Corp., 1820 
Dolley Madison Blvd., McLean, VA 22102. 
Classified sessions at the secret level are plan¬ 
ned. Preliminary unclassified abstracts and 
proposals for such sessions should be sent to 
Stephen Walker. 

IEEE Workshop on Languages for Automa¬ 
tion: August 24-27, 1987, Vienna. Submit 
papers by March 1, 1987, to M. Tauber, 

Dept, of Computer Science, University of 
Pittsburgh, Pittsburgh, PA 15260. 

International Conference on Supercomputing 
OFIP, SIAM): June 8-12, 1987, Athens. Sub¬ 
mit five copies of the paper by March 15, 

1987, to Elias Houstis, Dept, of Computer 
Science, Purdue University, West Lafayette, 
IN 47907 (authors in the Americas) or T. 
Papatheodorou, Computer Technology In¬ 
stitute, PO Box 1122, 26110 Patras, Greece 
(authors in other areas). 

Eighth Annual International Conference on 
Information Systems (ACM, SIM): December 
6-9, 1987, Pittsburgh. Submit four copies of 
the complete paper (25 pages maximum, in¬ 
cluding illustrations, tables, and references) 
by March 30,1987, to Charles H. Kriebel, 
Graduate School of Industrial Administra¬ 
tion, Carnegie Mellon University, Pittsburgh, 
PA 15213. 


Performance 87 (ACM, AFCET, IFIP): De¬ 
cember 7-9, 1987, Brussels. Submit five copies 
of a complete paper (20 pages maximum) by 
April 13,1987, to P.-J. Courtois, Philips 
Research Laboratory, 2 Ave. E. Van 
Becelaere, Box 8, B-1170 Brussels, Belgium; 
phone 32 (2) 673-41-90. 

ICCAD-87, IEEE International Con- 

ference on Computer-Aided Design: 
November 9-12, 1987, Santa Clara, Califor¬ 
nia. Submit 12 copies of both a one- 
paragraph abstract and a more detailed 
description not to exceed 1500 words or six 
pages by May 1, 1987, to ICCAD-87 
Secretary, Mentor Graphics Corp., 1940 
Zanker Rd., San Jose, CA 95112; (408) 
436-1500. 


CALENDAR 


January 1987 

IC-87, Symposium on Inteiligent Con- 
trol, January 18-20, Philadelphia. Con¬ 
tact A. Meystel, Drexel University, Dept, of 
Electrical and Computer Engineering, College 
of Engineering, Philadelphia, PA 19104; (215) 
895-2220. 

Syscon, OEM Computer Peripherals 
Subsystems Conference and Exposition, 
and Buscon 87 West, Bus/Board Users Show 
and Conference, January 19-21, Los Angeles. 
Contact Edward E. Grazda, 17100 Norwalk 
Blvd., Suite 116, Cerritos, CA 90701-2750. 

Fourth International Symposium on 
Modeling and Simulation Methodology: 
Intelligent Environments, Goal-Directed 
Models (SCS), January 19-23, Tucson, 
Arizona. Contact Paul A. Baltes, Office of 
Special Professional Education, University of 
Arizona, Harville Bldg., Box 9, Tucson, AZ 
85721;(602) 621-3054. 

Annual IEEE Design Automation 
Workshop, January 21-23, Apache 
Junction, Arizona. Contact Jim Armstrong, 
Electrical Engineering Dept., Virginia Tech, 
Blacksburg, VA 24061; (703) 961-4723 or 
(703) 961-7078. 

^ IEEE Workshop on Instrumentation 
for Distributed Computing Systems, 
January 22-23, Sanibel Nland, Florida. Con¬ 
tact Andre van Tilborg, Computer Science 
Dept., Carnegie Mellon University, Pitts¬ 
burgh, PA 15213; (412) 268-3801. 


February 1987 

Third International Conference on Data 
Engineering, February 2-6, Los 
Angeles. Contact Gio Wiederhold, Dept, of 
Computer Science, Stanford University, Stan¬ 
ford, CA 94305; (415) 497-0685 or Benjamin 
Wah, Coordinated Science Lab, University of 
lUinois, Urbana, IL 61801; (217) 333-5216. 

CSC-87, 1987 ACM Computer Science Con¬ 
ference, February 17-19, St. Louis. Contact 
Arlan DeKock, University of Missouri-Rolla, 
Computer Science Dept., Rolla, MO 65401; 
(314)341-4491. 

18th Annual SIGCSE Technical Sym- 
posium (ACM), February 19-20, St. 
Louis. Contact Dan C. St. Clair, UMR 
Graduate Engineering Center, University of 
Missouri-Rolla, 8001 Natural Bridge Rd., St. 
Louis, MO 63121-4499; (314) 553-5440. 


AionCorp., 101 University Ave., fourth 
floor, Palo Alto, CA 94301; (415) 328-9595. 

Workshop on Distributed Information 
Systems: Networks and Applications (IEEE), 
February 23, Washington, DC. Contact IEEE 
Workshop, 12498 Fan Leaf Court, Fairfax, 
VA 22033; or D. McDysan, (703) 734-2263; 
or B. Jabbari, (301) 428-5660. 

Compcon Spring 87, February 23-26, 
San Francisco. Contact Glen G. 
Langdon, Jr., IBM Dept. K54-802, 650 Harry 
Rd., San Jose, CA 95120-6099; (408) 
927-1818. 

Sixth Annual Phoenix Conference on Com¬ 
puters and Communications (IEEE), 

February 25-27, Scottsdale, Arizona. Contact 
Forouzan Golshani, Dept, of Computer 
Science, Arizona State University, Tempe, 

AZ 85287; (602) 965-2855. 


March 1987 


20th Annual Simulation Symposium 
'549 (ACM, IMACS, SCS), March 11-13, 
Tampa, Florida. Contact James Gantt, 5986 
Dana Dr., Norcross, GA 30093; (404) 
894-3107. 

19th Southeastern Symposium on 
^B^ Systems Theory, March 15-17, Clem- 
son. South Carolina. Contact Ernest Baxa, 
Jr., Electrical and Computer Engineering 
Dept., Riggs Hall, Clemson University, Clem- 
son, SC 29634-0915; (803) 656-5900. 

Tutorial Week Orlando 87, March 
16-20, Kissimmee, Florida. Contact 
Ratan Kumar Guha, Computer Science 
Dept., University of Central Florida, 

Orlando, FL 32816; (305) 275-2341. 

Sixth Symposium on Reliability in 
Distributed Software and Database 
Systems (NASA), March 17-19, 

Williamsburg, Virginia. Contact Edwin C. 
Foudriat, NASA, Langley Research Center, 
Information Systems Division, MS 469, 
Hampton, VA 23665; (804) 865-3535. 

1987 IEEE VLSI Test Workshop, March 
24-25, Atlantic City, New Jersey. Contact 
Wesley E. Radcliffe, IBM East Fishkill, Dept. 
277, Bldg. 321-5E1, Hopewell Junction, NY 
12533; (914) 8944346. 

Southcon (IEEE), March 24-26, Atlanta. 
Contact Electronic Conventions Manage¬ 
ment, 8110 Airport Blvd., Los Angeles, CA 
90045; (213) 772-2965. 


22-28, Orlando, Florida. Contact Jan Aikins, 


1 ^ IEEE Infocom 87, Sixth Annual Joint 
^z Conference of the IEEE Computer and 
Communications Societies: Global Net- 


January 1987 


129 










works—Concept to Realization, March 
30-April 2, San Francisco. Contact IEEE 
Infocom 87, 1730 Massachusetts Ave. NW, 
Washington, DC 20036-1903; (202) 371-0101; 
telex 7108250437 lEEECOMPSO. 


Ninth IEEE Internationai Conference 
on Software Engineering (ACM), 

March 30-April 2, Monterey, California. 
Contact William Riddle, Software Design and 
Analysis, 1760 Bear Mountain Dr., Boulder, 
CO 80303; (303) 499-4782. 

Fourth International Symposium on 
Optical and Optoelectronic Applied 
Science and Engineering (SPIE), March 
30-April 3, The Hague, The Netherlands. 
Contact Joseph Yaver, SPIE, PO Box 10, 
Bellingham, WA 98227-0010; (206) 676-3290. 


1987 IEEE International Conference on 
Robotics and Automation, March 30-April 3, 
Raleigh, North Carolina. Contact Harry 
Hayman, 738 Whitaker Terrace, Silver 
Spring, MD 20901; (301) 434-1990. 


April 1987 

Fourth International Workshop on 
Software Specification and Design 
(AFCET, Agence de ITnformatique, Alvey 
Directorate, LCRSTJapan), April 3-4, 
Monterey, California. Contact David Marca, 
Digital Equipment Corp., Intelligent Systems 
Tech Group, 77 Reed Rd., MS HL02-3/CID; 
Hudson, MA 01749. 

CHI-87, Conference on Human Factors in 
Computing Systems/GI-87, Graphics Inter¬ 
face (ACM, CIPS), April 5-9, Toronto. Con¬ 
tact William Buxton or Ron Baecker, Univer¬ 
sity of Toronto, Computer Systems Research 
Institute, Toronto, Ontario M5S 1A4, 
Canada. 


Electro 87 and Mini/Micro Northeast (IEEE), 
April 7-9, New York. Contact Dale 
Lltherland, Electro and Mini/Micro, 8110 
Airport Blvd., Los Angeles, CA 90045-3194; 
(213) 772-2965. 

1^1 IEEE Computer Society Symposium on 
Office Automation: Integration, Inter¬ 
connection, and Use of Personal Computers 
(NBS), April 27-29, Gaithersburg, Maryland. 
Contact Vincent Lum, Dept, of Computer 
Science, Naval Postgrad School, Monterey, 
CA; (408) 646-2449. 

IEEE Symposium on Security and 
Privacy, April 27-29, Oakland, Califor¬ 
nia. Contact Virgil Gligor, University of 
Maryland, Dept, of Electrical Engineering, 
College Park, MD 20742; (301) 454-8846. 


May 1987 


Eighth IEEE Symposium on Mass 
Storage Systems, May II-I4, Tucson, 
Arizona. Contact Patrick Savage, Shell 


Development Co., PO Box 481, Houston, TX 
77001: (713) 663-2384. 


Compeuro 87, International Conference 
^ on VLSI and Computers, May II-I5, 
Hamburg, West Germany. Contact W.E. 
Proebster, IBM Germany, Dept. 3280, Sci. 
Tech., Schoenaichen St. 220, Boeblingen 
7030, West Germany. 

IEEE Workstation Technology and 
Systems Workshop, May 12-13, Cherry 
Hill, New Jersey. Contact Ralph J. Preiss, 12 
Colburn Dr., Poughkeepsie, NY 12603. 

41^ Third International Symposium on 

VLSI Technology, Systems, and Appli¬ 
cations, May 13-15, Taipei, Taiwan. Contact 
Ben M. Y. Hsiao, IBM Corp., Dept. D18, 
Bldg. 707, PO Box 390, Poughkeepsie, NY 
12602 or Morris Chang, ITRI, No. 1, Jen Ai 
Rd., Sec. 2, Taipei, Taiwan. 

Eighth Symposium on Computer Arith- 
metic. May 18-21, Como, Italy. Contact 
Mary Jane Irwin, Dept, of Computer Science, 
333 Whitmore Laboratory, Pennsylvania 
State University, University Park, PA 16802 
or Luigi Dadda, Dept, of Electronics, Piazza 
Leonardo da Vinci 32, Politecnico di Milano, 
1-20133 Milan, Italy. 

CG International 87, Fifth International Con¬ 
ference on Computer Graphics in Japan 
(CGS), May 25-28, Karuizawa, Nagano 
Prefecture, Japan. Contact Tosiyasu L. 

Kunii, Dept, of Information Science, Faculty 
of Science, University of Tokyo, Hongo, 
Tokyo 113, Japan; phone 81 (03) 812-2111, 
ext. 4116. 


1987 International Symposium on 
Multiple-Valued Logic, May 26-28, 
Boston. Contact Dan Simovici, Dept, of 
Mathematics and Computer Science, Univer¬ 
sity of Massachusetts, Boston, MA 02125; 
(617) 929-7966. 


June 1987 

IFIP Workshop on CAD Engines, June 
1-2, Kakaishinlou, Kainkan, Japan. 
Contact Tatsuo Ohtuski, Waseda University, 
Dept, of Elec, and Comm., School of Science 
and Engineering, 3-4-2 Okubo, Shinjuku, 
Tokyo 160, Japan: phone 81 (03) 209-3211. 

Westex-87, Second Western Expert 
Systems Conference, June 2-4, 
Anaheim, California. Contact Westex 87, PO 
Box 2111, Fullerton, CA 92633-0111. 

14th International Symposium on Com- 
puter Architecture, June 2-5, Pitts¬ 
burgh. Contact Zary Segall, Computer 
Science Dept., Carnegie Mellon University, 
Pittsburgh, PA 15213; (412) 268-3736. 


ICCV-87, First International Con- 
ference on Computer Vision, June 8-11, 
London. Contact Azriel Rosenfeld, University 
of Maryland, Center for Automation 


Research, College Park, MD 20742; (301) 
454-4526. 

IEEE Workshop on Software Tech- 
nology Transfer, June 11-13, Santa Fe, 
New Mexico. Contact Charles Richter, MCC, 
Software Tech. Prog., 9430 Research Blvd., 
Austin, TX 78759. 

NCC-87, National Computer Conference 
(ACM, AFIPS, DPMA, SCS), June 15-18, 
Chicago. Contact AFIPS, 1899 Preston White 
Dr., Reston, VA 22091; (703) 620-8900. 

Second Annual Conference on Struc- 
ture in Complexity Theory, June 16-19, 
Ithaca, New York. Contact Alan Selman, 
College of Computer Science, 161 Cullinane 
Hall, 360 Huntington Ave., Boston, MA 
02215; (617) 437-8688. 

NATO Advanced Study Institute on Testing 
and Diagnosis of VLSI and ULSI, June 
22-July 4, Como, Italy. Contact F. Lombar¬ 
di, University of Colorado at Boulder, Cam¬ 
pus Box 425, Boulder, CO 80309; (303) 
492-1437 or M. Sami, Dept, di Elettronica, 
Politecnico di Milano, Piazza Leonardo da 
Vinci 32,1-20133 Milan, Italy; phone 39 (2) 
2399-3516. 

NECC-87, Eighth National Educational Com¬ 
puting Conference (ACM, SCS), June 24-26, 
Philadelphia. Contact Frank L. Friedman, 
Computer Activities Bldg., Box JAl, Dept, of 
Computer and Information Sciences, Temple 
University, Philadelphia, PA 19122; (215) 
787-8450. 

Second International Conference on 
Computer Applications, June 24-26, 
Beijing. Contact Tse-yun Feng, Penn State 
University, Electrical Engineering East Bldg., 
University Park, PA 16802 or Oscar N. Gar¬ 
cia, Dept, of Electrical Engineering and 
Computer Science, Rm. T-637, George Wash¬ 
ington University, 801 22nd St. NW, 
Washington, DC 20052; (202) 676-7175. 

SIGPIan 87, Symposium on Interpreters 
and Interpretive Techniques (ACM), 
June 24-26, St. Paul, Minnesota. Contact 
Mark Scott Johnson, Hewlett-Packard Labs, 
1501 Page Mill Rd., 3024, Palo Alto, CA 
94304-1181. 

^ DAC-87, 24th ACM/IEEE Design 
Automation Conference, June 28-July 
1, Miami Beach, Florida. Contact Design 
Automation Conference, P.O. Pistilli, MP 
Associates, 7366 Old Mill Trail, Boulder, CO 
80301; (303) 5304562. 


July 1987 

CAR-87, Second International Con- 
ference on Computer-Assisted Radi¬ 
ology (ACM), July 14, Berlin. Contact 
Michael L. Rhodes, Multi-Planar Diagnostic 
Imaging, Inc., 2730 Pacific Coast Hwy., 
Torrance, CA 90505; (213) 539-5944. 
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CAREER OPPORTUNITIES 


RATES: $12 per line, $120 minimunn charge (up 
to ten lines). Average six typeset words per line, 
nine iines per column inch. Add $10for box num¬ 
ber. Send copy at least six weeks prior to month 
of pubilcation to: Carole Porter, Classified 
Advertising, iEEE COMPUTER Magazine, 10662 
Los Vaqueros Circle, Los Alamitos, CA 90720. 


STATE UNiVERSITY OF NEW YORK 
AT BUFFALO 

The Department of Computer Science is seeking 
tacuity at the ievei of Assistant Professor to 
begin Faii, 1987. Applicants must haveaPh.D. in 
Computer Science, or a reiated fieid, and 
superior research abliity. 

The University at Buffaio is the iargest public 
university in New York and New Engiand, with 
approximateiy 26,000 students enroiled in 93 
undergraduate, 101 master’s, and 94 doctorai 
programs, inciuding iaw, medicai, and business 
schools. 

The Department offers BA, BS, MS, and PhD 
degrees, with oontroiied undergraduate enroii- 
ment. Departmental computing facilities inciude 
a VAX 11/780, two VAX-11/750S, six SUNs, six iisp 
machines and severai image processing/graph¬ 
ics systems. Present research areas inciude ar- 
tificiai inteiiigence, computer vision, numerical 
analysis, parallel algorithms, theory of computa¬ 
tion, VLSI, etc. The Department Is expanding, 
with additional faculty lines committed annuaiiy. 
Salaries are extremeiy competitive. 

Resumes and names of four references shouid 
be directed to: Prof. Sargur N. Srihari, Chairman 
of Search Committee, Department of Computer 
Science, 226 Beii Haii, SUNYat Buffaio, Buffaio, 
NY 14260 (CSnet: srihari® buffaio). SUNY is an 
affirmative action/equai opportunity empioyer. 


UNIVERSITY OF CALIFORNIA, DAVIS 
Faculty Positions in Electrical and Computer 
Engineering/Computer Science 

The Department of Electrical and Computer 
Engineering at UC Davis invites appiications for 
tenure track positions at ail ranks in all special¬ 
ties of eiectrical engineering, computer engi¬ 
neering, and computer science. Of particular 
interest are faculty positions in the areas of in¬ 
tegrated optics and opto-electronics, computer 
architectures, artificial intelligence, computer 
communications, and image processing. 

The department, with 40 facuity members and 
150 fuli-time graduate students, is experiencing 
rapid growth. Our Coliege is the nation’s six¬ 
teenth iargest producer of engineering Ph.D.’s in 
a University which has the twentieth iargest ex- 
tramurai research funding. Saiary and benefits 
are extremely attractive. 

Davis is a pieasant, family oriented community, 
within easy driving distance to Siiicon Valiey, 
the Lawrence Livermore National Laboratory, 
San Francisco, the Pacific Ocean, and the Sierra 
Nevada Mountains. 

We are seeking individuais with strong records 
of teaching and research with ambitious pians. 
Senior appointments require outstanding 
records of achievement: junior appointments 


must show evidence of great promise. Ali faculty 
are expected to have a strong commitment to 
teaching at ail degree levels, and to demonstrate 
the ability to attract significant research support. 
The positions require a Ph.D. degree or 
equivalent, and are open until filled. Send a 
resume and the names of at least three 
references to: 

Professor S. Louis Hakimi, Chair 
Department of Eiectrical and 
Computer Engineering 
University of Caiifornia 
Davis, CA 95616 

The University of Caiifornia, Davis, is an equai 
opportunity/affirmative action employer. 


MEMPHIS STATE UNIVERSITY 
Department of Mathematical Sciences 

The Department of Mathematical Sciences in¬ 
vites appiications for tenure track positions at aii 
ranks in aii areas of computer sciences for Faii 
1987. Preferred research areas include algo¬ 
rithms, parallel and distributed processing, ar- 
tificiai inteiiigence/cognitive science, and soft¬ 
ware development. Applicants must have a Ph.D. 
by September 1,1987, and a strong potential for 
excellence in teaching and research. 

The Department offers degrees at aii ieveis in- 
ciuding the Ph.D., and provides a very favorabie 
research environment in terms of library and 
computing faciiities (inciuding a symbolic Intei 
Hypercube), teaching ioad, travei opportunities, 

Seiection wiii begin on February 1, 1987. Ap¬ 
piications wiii continue to be accepted until all 
positons are filled. Applicants should submit a 
resume and direct three ietters of reference to: 
Raiph Faudree, Chairman 
Department of Mathematicai Sciences 
Memphis State University 
Memphis, TN 38152 

An Equai Opportunity/Affirmative Action 
Empioyer 


GEORGE WASHINGTON UNIVERSITY 
Tenure-Track Faculty Positions 

The Department of Electrical Engineering and 
Computer Science invites applications for 
tenure-track faculty positions. We particularly 
seek persons active in the areas of Computer 
Science and Communications. Candidates 
should have an earned doctorate and research 
experience, with an interest in both teaching and 
research. Ability to attract research grants and 
contracts for support of faculty and student as¬ 
sistants is valued. The George Washington Uni¬ 
versity is located in the center of Washington, 
DC. This metropolitan area sustains the second 
largest concentration of research and develop¬ 
ment activity in the United States which creates 
a continuing demand for rigorously trained engi¬ 
neers as well as broad research opportunities. 
Our department is the largest department in the 
School of Engineering and Applied Science with 
33 full-time faculty, and a large graduate and 
undergraduate student body. The department 
has an annual research budget of close to $1 


million. Send Curriculum Vitae, list of publica¬ 
tions and references, to: 

Professor Roger H. Lang, Chairman 
Department of Electrical Engineering and 
Computer Science 

School of Engineering & Applied Science 
THE GEORGE WASHINGTON UNIVERSITY 
Washington, DC 20052 

The University is an affirmative action/equal op¬ 
portunity employer. 


HAVERFORD COLLEGE 
Tenure track position in Computer Science 

Haverford College announces a tenure-tracx 
opening in Computer Science at the Assistant or 
untenured Associate Professor level. Can¬ 
didates should expect to play a leading role in 
developing an undergraduate program in Com¬ 
puter Science, appropriate to a liberal arts en¬ 
vironment. Haverford has close ties to Bryn 
Mawr and Swarthmore Colleges, and the three 
colleges plan extensive cooperation and sharing 
of resources in Computer Science. Haverford ex¬ 
pects its faculty to maintain a clear commitment 
to research as well as teaching at the under¬ 
graduate level. Salaries are competitive, and the 
college is prepared to offer additional support 
for research equipment and maintenance costs. 
A Ph.D. degree is expected by September 1987. 
Curriculum vitae and three letters of recommen¬ 
dation should be sent by February 15, 1987 to 
Curtis Greene, Chairman, Computer Science 
Search Committee, Haverford College, Haver¬ 
ford, PA 19041. 

Haverford is an Equal Opportunity/Affirmative 
Action employer. 


UNIVERSITY OF ALASKA-FAIRBANKS 

The Computer Science faculty Invite applica¬ 
tions for anticipated tenure-track and visiting 
faculty positions, to be filled September, 1987, or 
January, 1988. Rank depends on qualifications. 
The University of Alaska-Fairbanks is the major 
research institution in the University of Alaska 
system and is the site of several world famous 
research institutes. The Department of Mathe¬ 
matical Sciences offers B.S. and M.S. degrees in 
Computer Science. The University facilities in¬ 
clude a research quality library and a statewide 
computer network of VAX 8800 and 8600 com¬ 
puters. In addition, the Department has a VAX 
11/780, PDP 11/23, several Masscomp color 
graphics work stations, and smaller computers. 
Applicants should have a Ph.D. in Computer 
Science or equivalent. Applicants with research 
interests in any field will be considered. Some 
preference will be given to applicants with exper¬ 
tise in operating systems, architecture, and hard¬ 
ware. Salary is competitive and fringe benefits 
are excellent. Resume and three letters of 
reference should be directed to Dr. Clifton Lan- 
do. Head, Department of Mathematical Sci¬ 
ences, University of Alaska, Fairbanks AK 
99775-1110. Inquiries: (907) 474-7117 or 
FFBML@ALASKA.BITNET. Deadline for appli¬ 
cations; March 15, 1987. UAF is an Equal 
Opportunity/Affirmative Action employer and 
educational institution. 
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THE UNIVERSITY OF MICHIGAN 
Ann Arbor, Michigan 
Faculty Positions Available 
in 

Electrical Engineering and Computer Science 

Applications are solicited for several additional 
faculty positions at all ranks in various areas of 
electrical engineering and computer science 
and engineering. Qualifications include an 
outstanding academic record, significant in¬ 
volvement in research, a doctorate in electrical 
or computer engineering or computer science, 
and a strong commitment to teaching and 
research. Areas of specialization are not 
restricted. However, solid-state devices, circuits 
and microelectronics, optics, communication 
networks, image processing, VLSI, operating 
systems, computer architecture, software 
engineering, artificial intelligence, languages 
and compilers, as well as robotics and in¬ 
tegrated manufacturing, are of particular in¬ 
terest. Please send resumes; 

Professor George I. Haddad, Chairman 
Department of Electrical Engineering and 
Computer Science 
The Uhiversity of Michigan 
Ann Arbor, Ml 48109-2122 
An equal opportunity/affirmative action 
employer. 


UNIVERSITY OF PITTSBURGH 
Department of Computer Science 
Junior and Senior Faculty Positions 

The Department of Computer Science is enter¬ 
ing a period of substantial growth. Several 
tenure track faculty positions are to be filled as 
soon as possible, before the end of 1987. Others 
will be allocated subsequently. Responsibilities 
include research, supen/ision of graduate stu¬ 
dent research and graduate and undergraduate 
teaching. A Ph.D. in computer science or in a 
closely related field is required. Any area of 
specialty in computer science will be con¬ 
sidered, although preference will be given to pro¬ 
gramming languages, operating systems, algo¬ 
rithms, and theory of computation. Salary and 
rank will be commensurate with a candidate’s 
established record of scholarly achievement 
and/or research potential. 

Additional positions, which are joint appoint¬ 
ments with other academic units, are available 
for the following areas: telecommunications, ar¬ 
tificial intelligence, and supercomputing. 

The Department has twenty full-time faculty 
members, strong graduate (M.S. and Ph.D.) and 
undergraduate (B.S.) programs. It has an ex¬ 
cellent research library. Departmental com¬ 
puting facilities Include a VAX 11/780 (under bsd 
UNIX), a PDP-11/70 (UNIX), several smaller 
PDP-11 systems, a variety of microcomputers, 
several graphics systems, eleveh SUN worksta¬ 
tions, and a network of Xerox 1100-series 
(Dandelion) workstations. The research systems 
are accessible via the Department’s Ethernet- 
compatible LAN. Convenient access is also pro¬ 
vided to the extensive general computer 
facilities of the University as well as to other net¬ 
works (e.g., CSNET). The Department operates 
the Research Institute for Parallel and Dis¬ 
tributed Intelligence Systems (IPDIS) to provide 
an environment for innovative research in com¬ 
puter science, and cooperates closely with the 
Pittsburgh Super-Computing Center, which 
operates CRAY X-MP/48. 

Pitt is an equal opportunity/affirmative action 
employer. 

Please send your resume to: Dr. Shi-Kuo Chang, 
Chair, Department of Computer Science, Univer¬ 
sity of Pittsburgh, Pittsburgh, PA 15260. CSNET 
Address CHANG® PITT. 


CLEMSON UNIVERSITY 
Computer Engineering 

ELECTRICAL and COMPUTER ENGINEERING 
at CLEMSON UNIVERSITY is seeking applicants 
for tenure-track and visiting positions in Com¬ 
puter Engineering program offering BS, MS and 
PhD degrees. All areas of computer engineering 
are of interest, with special emphasis on 
distributed system software and hardware, com¬ 
puter networking and computer architecture. 
Positions in Electrical Engineering degree pro¬ 
gram also available, with areas of specialization 
including microelectronics, reliability, robotics, 
communications, signal processing, elec¬ 
tromagnetics and power. 

Applicants should have a Ph.D. and a strong in¬ 
terest in teaching and research. Research 
Associate positions (BS,MS) are also available. 
Send resumes to Dr. A. Wayne Bennett, E&CE 
Department, Clemson University, Clemson, SC 
29634-0915. Clemson is an Equal Opportunity/Af¬ 
firmative Action Employer. 


STANFORD UNIVERSITY 
Faculty Openings 

The Departments of Electrical Engineering and 
Computer Science have a number of openings 
for regular and adjunct faculty and research posi¬ 
tions. Applications are invited. Applicants 
should have a demonstrated research ability in 
one or more areas of computer hardware and 
software such as VLSI design, computer ar¬ 
chitecture, operating systems, or programming 
languages. 

All applicants will be considered for positions 
beginning with the fall quarter 1987. 

Stanford University is an affirmative action. 
Equal Opportunity Employer and welcomes ap¬ 
plications from women and minority groups. 
Please submit, as soon as possible, a detailed 
resume, including references to Professor John 
Hennessy, Chairman, Search Committee, Com¬ 
puter Systems Laboratory, Department of Elec¬ 
trical Engineering, Stanford University, Stanford, 
California 94305. 


DIALOGUE MANAGEMENT ARCHITECT 

Engage in fundamental cognitive science and 
evaluative research in the area of software to 
support advanced dialogues between humans 
and machines including the design, implementa¬ 
tion, and report of original experiments. Utilize 
background in psychology, quantitative 
methods and statistics, artificial intelligence, 
linguistics (including current research in syntax, 
semantics, and dialogue analysis), and human 
comprehension to design and evaluate software 
that will model the human’s comprehension pro¬ 
cess. Tailor machine queries and responses to 
determine the user’s goals, increase the user’s 
understanding of the machine’s capabilities, ac¬ 
commodate or correct user errors, and present 
results in forms most comprehensible to the 
user. Demonstrated ability to perform in¬ 
novative, original research as shown by publica¬ 
tions in appropriate fields and successful record 
as research assistant in a major research univer¬ 
sity; LISP programming ability, at least equiva¬ 
lent to the constructioh of one non-trivial 
system; and ability to evaluate computer sys¬ 
tems for their usability and learnability for users 
in an industrial setting. Applicants must have a 
Ph.D. in Psychology. Apply at the Texas Employ¬ 
ment Commission, TEC Building, Austin, Texas 
78778, J.O. #4640628. Ad Paid by an Equal 
Employment Opportunity Employer. 


UNIVERSITY OF MASSACHUSETTS 

Faculty positions in Electrical and Computer 
Engineering. The Department of Electrical and 
Computer Engineering at the University of 
Massachusetts at Amherst is one of the largest 
in New England with 35 faculty and 275 graduate 
students. The Department invites applications 
for tenure-track/tenured positions in: All areas of 
Computer Engineering. Already in place are 
strong programs in hardware, computer ar¬ 
chitecture, VLSI, and distributed processing. 
Computer facilities including CYBER 174 and 
175 machines together with a number of net¬ 
worked VAX 11/780, 11/785 and microVAX 
machines. The department is the recipient of 
substantial computing equipment for VLSI- 
related instruction from the Massachusetts 
Technology Park Corporation (MTPC) and has 
mahy ties with computer companies in the Com¬ 
monwealth providing research, equipment, con¬ 
sulting and teaching support. Candidates for 
senior positions are expected to have excellent 
research records and junior candidates must 
show strong research potential. All candidates 
must have interests in teaching as well as a 
strong research orientation. Teaching loads are 
generally conducive to the establishment or ex¬ 
pansion of high-quality research programs. At¬ 
tractive features of the Uhiversity of Massachu¬ 
setts are the quality of life in the town of 
Amherst and the University’s proximity to the 
commonwealth’s high-technology industry. 
Salaries are competitive and commensurate 
with experience. Send resume and names of 
three references to Professor Keith R. Can/er, 
Head, Department of Electrical and Computer 
Engineering, University of Massachusetts, 
Amherst, MA 01003 by March 15, 1987. The 
University of Massachusetts is an Affirmative 
Action/Equal Opportunity Employer. 


UNIVERSITY OF SOUTHERN CALIFORNIA 

The Department of Electrical Engineering-sys¬ 
tems at the University of Southern California an¬ 
nounces tenure track positions at all levels in 
computer engineering. We are especially inter¬ 
ested in candidates with background and/or ex¬ 
perience in robotics, Al for vision, computer per¬ 
formance and CAD for VLSI. Send a resume and 
the names of at least three academic references 
to: Jerry M. Mendel, Chairman, Dept, of Electrical 
Engineering-Systems, University of Southern 
California, Los Angeles, CA 90089-0781. USC is 
an equal opportunity/affirmative action 
employer. 


CONSULTING SYSTEMS ENGINEER 

Engineer to be principal architect for IMS/LU6.2 
interface for large California bank. Will develop 
specs and design for distributed data proces¬ 
sing utilizing IBM’s IMSA/S, CICSA/S, TPF2.2 
and APPC/PC technologies. Requires BSCS or 
equivalent and 4 yrs. experience (if no formal 
degree, 2 yrs. college and 8 yrs. experience); in- 
depth knowledge of: banking systems requiring 
24-hour on-line processing and transaction 
processing capacities in excess of 50 tps; 
IMS/VS DB/DC intervals; IMS/VS fastpath 
internals; IMS/VS MFS and its implementation of 
DPM; SNA implementation of IMSA/S LU type P, 
LU type 2.0; broad knowledge of: IMSA/S XRF; 
CICS; IBM’s SNA architecture & LU type 2, LU6.2; 
SNA implementation of TRFII SLU Type P; 
CICSA/S; LU type 6.1 and 6.2 and APPC. Must be 
able to explain highly technical material to less 
technically adept staffs. 40 hrs./week; $55K/year. 
Job and interview site: San Francisco, CA. Send 
this ad and resume to Job # FC 8892, P.O. Box 
9560, Sacramento, CA 95823-0560 not later than 
1/30/87. 
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RUTGERS UNIVERSITY 
Computer Engineering 

Rutgers University has openings for tenure-track 
facuity in its newiy organized Computer 
Engineering Program. Appiicants with 
speciaiization in software engineering, VLSI 
design and testing, computer graphics, image 
processing, computer architecture and paraliei 
processing are of particular interest. Excellent 
computer and research latxjratory facilities are 
available. Teaching loads are modest and reflect 
the university’s objective of building a program 
with excellence in teaching and research. Ap¬ 
plicants are expected to have a strong commit¬ 
ment to both research and teaching. Interested 
individuals should send a resume and the names 
of four references to 
Professor Herbert Freeman 
Computer Engineering Program 
Rutgers University 
P.O. Box 909 
Piscataway, NJ 08854 

Rutgers is an equal-opportunity, affirmative- 
action employer. 

UNIVERSITY OF WISCONSIN-MILWAUKEE 
Department of Electrical Egineering 
and Computer Science 

Applications are invited for faculty positions in 
Computer Science. Candidates should have a 
Ph.D. in Computer Science or a related disci¬ 
pline. A commitment to research and teaching is 
expected. Senior candidates should have a 
strong and established research record. Prefer¬ 
red areas are: programming languages, com¬ 
pilers, theory, systems, and artificial in¬ 
telligence. Research investigations by our cur¬ 
rent Computer Science faculty are in the areas of 
databases, data security, theory of computation, 
expert systems, computer architecture, parallel 
computation, and artificial intelligence. 

The University of Wisconsin—Milwaukee cam¬ 
pus is located near the shores of Lake Michigan 
and is close to pleasant and beautiful residential 
areas. Interested persons should send a resume 
with three references to: 

Professor K. Vairavan 
Chairperson—Computer Science 
Department of Electrical Engineering & 
Computer Science 
University of Wisconsin—Milwaukee 
P.O. Box 784 
Milwaukee, Wl 53201 


UNIVERSITY OF MARYLAND 

The Electrical Engineering Department of the 
University of Maryland College Park has open¬ 
ings for regular faculty positions in computer 
engineering. Candidates for the rank of Assis¬ 
tant Professor should have a high potential for 
both teaching and research. Candidates for the 
rank of Associate Professor and Full Professor 
should have distinguished records in research 
and a strong interest in educational programs. 
The department conducts research and educa¬ 
tional programs in all areas of computer engi¬ 
neering. Although applications in all areas of 
computer engineering will be considered, net¬ 
working, operating systems, computer security, 
architectures for parallel computing, and VLSI 
design are currently the highest priority areas for 
adding new faculty. Application, including re¬ 
sume, list of publications, list of references, 
identification of technical area for which the can¬ 
didate wishes to be considered, should be seht 
to Dr. William W. Destler, Chairman, Electrical 
Engineering Department, University of Maryland, 
College Park, Maryland 20742. The University of 
Maryland is an equal opportunity, affirmative ac¬ 
tion employer. 


SOUTHERN METHODIST UNIVERSITY 
Department of Computer Science and 
Engineering 

The Department of Computer Science and 
Engineering invites applications for a tenured 
senior faculty position and regular tenure-track 
or visiting faculty positions at all ranks. Ap¬ 
plicants for the senior position should have out¬ 
standing reputation in academic pursuits and ex¬ 
perience in leading group research projects. 
Applicants for the regular tenure-track positions 
should have a Ph.D. degree and demonstrated 
research and teaching experience in computer 
science, ora related area. Salary wil be commen¬ 
surate with qualification and experience. 

SMU is a private university with approximately 
9000 students. CSE is in the School of Engineer¬ 
ing and Applied Science, where a close working 
relationship exists with the Departments of Elec¬ 
trical Engineering and Operations Research of 
SEAS, and with Mathematics Department and 
Business School. The Department has extensive 
contacts with computer-related and engineering- 
oriented industrial firms that distinguish Dallas 
as one of the top centers for high technology, 
and which has pushed Dallas into major promi¬ 
nence in executive and research lab relocation. 
CSE presents a balanced program of research 
and education at all levels and has been offering 
Ph.D. programs for some twenty years. Our cur¬ 
rent faculty strength lies in scientific computa¬ 
tion and knowledge/data based systems. Pre¬ 
ferred specialties for new faculty are computer 
and system architecture, artificial intelligence, 
software engineering, and parallel algorithms 
and systems. Departmental computing facilities 
include a VAX 11/780, several Sun Microsys¬ 
tems, a PDP 11/70, three LISP machines, 
numerous personal computers, graphics equip¬ 
ment, and EPROM and 1C testing equipment. 
CSE has recently moved to new expanded 
facilities, and has been targeted for exceptional 
growth in the University’s new planning docu¬ 
ment, “The Decade Ahead.’’ 

Applicants should send a complete resume, in¬ 
cluding three references to: 

D.Y.Y. Yun, Chairman 
Department of Computer Science and 
Engineering 

Southern Methodist University 
Dallas, TX 75275 

SMU is an equal opportunity/affirmative action 
employer. Applications from women and 
minorities are particularly encouraged. 


UNIVERSITY OF MIAMI 
Electrical and Computer Engineering 
Chairperson 

The Electrical and Computer Engineering 
Department of the University of Miami invites ap¬ 
plications from qualified candidates in the fields 
of electrical engineering, computer engineering 
and computer sciences for the position of Chair¬ 
person. Candidates should have an earned doc¬ 
torate in one of the above fields as well as 
teaching, industrial or government experience: 
substantial record of externally funded research; 
and evidence of leadership ability. The Depart¬ 
ment, which is the largest in the College of 
Engineering, has 18 full-time faculty plus 2 open 
lines, with both undergraduate and graduate 
(M.S. and Ph.D.) programs. Applications with 
resumes and names of three references (with ad¬ 
dresses) should be sent to Dr. T. Nejat Veziroglu, 
ECE Chair Search Committee, College of Engi¬ 
neering, P.O. Box 248294, Coral Gables, Florida 
33124; phone (305) 284-4666. The application 
deadline is January 20,1987. Starting date is no 
later than August 15, 1987. The University of 
Miami is an affirmative action/equal opportunity 
employer. 


WEST VIRGINIA UNIVERSITY 

ELECTRICAL AND COMPUTER ENGINEERING: 
The Electrical Engineering Department at West 
Virginia University anticipates available faculty 
positions for 1987-88 in the areas of digital and 
computer engineering systems design, telecom¬ 
munications, microelectronics, and electromag¬ 
netics. (Applicants are requested to identify their 
field of interest in their cover letter of transmittal 
of curriculum vitae.) Salary and rank will be com¬ 
mensurate with qualifications. Positions will be 
tenure track. Applicants must have the Ph.D., 
potential for high quality teaching and will be ex¬ 
pected to initiate research and participate in 
departmental research programs. Curriculum 
vitae should be sent to: Dr. Ronald L. Klein, Pro¬ 
fessor and Chairman, Department of Electrical 
Engineering, West Virginia University, P.O. Box 
6101, Morgantown, WV 26506-6101. Applications 
should be received by March 31,1987 although 
searches for available positions will continue un¬ 
til filled. West Virginia University is an affir¬ 
mative action/equal opportunity employer m/f. 


RENSSELAER POLYTECHNIC INSTITUTE 
Computer Engineering Positions Availabie 

Several junior-level, tenure-track faculty posi¬ 
tions are available in the computer engineering 
area, as part of a recently approved plan for 
growth and expansion in the Department of Elec¬ 
trical, Computer, and Systems Engineering. The 
Department is the largest academic unit at 
Rensselaer Polytechnic Institute (RPI) with 45 
full-time faculty members and approximately $4 
million in external research. In the 1985-1986 
academic year, the Department awarded 303 
bachelor degrees, 117 masters degrees, and 18 
doctoral degrees. The Department’s faculty are 
engaged in several areas of advanced study and 
research, including computer engineering, auto¬ 
matic control (induing robotics and automation), 
information and decision systems (including 
manufacturing systems), communication and 
signal processing (including telecommunica¬ 
tion), electronics and circuits, solid state, and fu¬ 
sion plasmas. 

Applicants must have an earned doctorate. Priori¬ 
ty is given to applicants who have the following 
interests and background: computer architec¬ 
ture, computer hardware design, VLSI design, 
parallel processing, computer performance 
evaluation, knowledge-based systems and artifi¬ 
cial intelligence. Research opportunities exist in 
association with one of the many Department 
laboratories or one of the three major reseach 
centers (Center for Integrated Electronics, 
Center for Interactive Computer Graphics, and 
Center for Manufacturing Productivity and 
Technology Transfer). Additionally, faculty are 
encouraged to seek individual research grants 
and to consult independently. Successful ap¬ 
plicants will receive special initial benefits as 
new faculty members, including summer 
remuneration, a reduced teaching load, research 
assistant support, etc. 

While this search is primarily for junior faculty, 
established senior faoulty with a strong 
reasearch and publication record are also en¬ 
couraged to apply. Opportunities exist for ap¬ 
pointment to a Chaired position. 

Applicants should send a resume, the names 
and addresses of four references, and a letter in¬ 
dicating their reseach and teaching interests to: 
Dr. James M. Tien 
Acting Department Head 
Department of Electrical, Computer, and 
Systems Engineering Department 
Rensselaer Polytechnic Institute 
Troy, New York 12180-3590 
RPI is An Affirmative Aotion/Equal Opportunity 
Employer 
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CALIFORNIA STATE UNIVERSITY 
San Bernardino 

POSITION FOR LECTURER [non-tenured] 
($25,811-$49,547). 

ASST. PROF. ($31,489-$37,871). 

ASSOC. PROF. ($36,077-$43,472). 

OR FULL PROF. ($44,343-$53,507) of COM¬ 
PUTER SCIENCE dependent on qualifications 
and experience. 

Duties inciude teaching, advising, curricuium 
deveiopment, program evaiuation and communi¬ 
ty interaction. Teaching ioad equated to 12 
hrs/wk of iecture and iab. Ph.D. in CSci is prefer¬ 
red, but an MS in CSci with Ph.D. in reiated fieid 
wiii be considered. Candidates with an MS in 
CSci working towards a Ph.D. may be con¬ 
sidered fora iecturerappointment. Facilities in¬ 
ciude CDC Cyber 720 and 730-760, Prime 9750, 
DEC PDP 11 computers, many PCs, micropro¬ 
cessors and terminais. 

The University is iocated in one of the fastest 
growing service areas in the USA with a current 
student popuiation over 7500 and more than 300 
computer science majors. The area is noted for 
its warm climate and is within one hour of 
beaches, mountain resorts and metropolitan Los 
Angeles without their high living costs. Ap¬ 
plicants should submit letter of application, 
vitae, 3 letters of recommendation and official 
transcripts. Selection will be completed no 
sooner than March 15, 1987. Send materials to: 
Dr. Richard J. Botting, Chair, Department of 
Computer Science, California State University, 
5500 University Parkway, San Bernardino, CA 
92407, BITNET:PAAAAAR@CALSTATE. 

An Equal Opportunity/Affirmative Action, Sec¬ 
tion 504, Title IX Employer. 

GEORGIA INSTITUTE OF TECHNOLOGY 

The School of Information and Computer 
Science invites applications for faculty posi¬ 
tions at all levels. Applicants should have a com¬ 
mitment to teaching and should show a record of 
outstanding research accomplishments or ex¬ 
pect to receive a Ph.D. degree by Fall 1987 and 
show high potential for research. The School 
seeks applicants to strengthen its capabilities in 
all areas of current research activity, especially 
artificial intelligence, software engineering, dis¬ 
tributed computer systems, and also in com¬ 
puter graphics, programming languages, theo¬ 
retical computer science, human factors, VLSI 
systems, data communications and computer 
networks, database systems, and computer 
architecture. Very competitive salaries are 
offered. 

The School is well supported by the Institute. It 
has 24 faculty members and is currently experi¬ 
encing substantial faculty growth. Its education¬ 
al activities include an undergraduate program 
accredited by the Computing Sciences Accred¬ 
itation Board, Inc., a Masters program with 150 
students and a Ph.D. program with over 70 
students. Well equipped separate laboratories 
support research and education. High-speed 
local area networks interconnect all major cam¬ 
pus laboratories and provide access to CSNet 
and other national networks. 

Georgia Tech is located in Atlanta, which ex¬ 
periences a mild sunbelt climate. It is the center 
of commerce in the Southeast, offering a diverse 
economy and good employment opportunities in 
all professional areas. Atlanta offers good 
cultural and recreational opportunities, extreme¬ 
ly attractive residential neighborhoods, and af¬ 
fordable housing. 

Candidates should send complete resumes and 
names of at least three references to: Professor 
Nancy D. Griffeth, Chairman, Faculty Search 
Committee; School of Information and Com¬ 
puter Science; Georgia Institute of Technology; 
Atlanta, Georgia 30332. 

Georgia Tech is an equal opportunity employer 


COMPUTER PROGRAMMING MANAGER 

COMPUTER PROGRAMMING MANAGER to 
design and customize a computer clinical 
laboratory software and hardware package 
which will be used for hospital application. 
Worker will discuss the requirements necessary 
with the Chief Technologist and then translate 
these requirements into a software design on a 
computer. Worker must have the ability to con¬ 
verse both in the area of chemical and biological 
assays as well as in the area of computer soft¬ 
ware languages. In order that the final product 
can be fully integrated with the existing hospital 
information systems, worker must have a knowl¬ 
edge of order-entry, accounts receivable, patient 
accounting, general ledger, materials manage¬ 
ment, payroll, fixed assets, admission, dis¬ 
charge and transfer subsystems in order that 
proper interfaces are in the design. Worker will 
program the software product on the MAI Basic 
Four computer using knowledge of the hardware 
in order to optimize the data storage require¬ 
ments and the execution speed. Upon comple¬ 
tion of the programming, worker will oversee the 
installation, and client training, of the finished 
product. Bachelor degree with major field of 
study being in Accounting, Business or Science 
plus 4 years experience required. $1,000 per 
week. Place of employment and interviews: 
Laguna Hills, CA. Send this ad and your resume 
to Job #CW9429, P.O. Box 9560, Sacramento, CA 
95823-0560 not later than January 31, 1987. 

WESTERN WASHINGTON UNIVERSITY 

Funding permitting. Computer Science will have 
two tenure-track openings for the academic year 
starting Sept., 1987. Ph.D. in Computer Science 
or closely related field is required. There Is need 
to staff the mainline undergraduate courses and 
to strengthen the masters’ program. 

For more information, please contact James 
Johnson, Chairman, Computer Science Dept., 
Western Washington University, Bellingham, 
Washington 98225; CSNET address; johnson 
%wwu@ csnet-relay.arpa WWU is an EO/AA 
employer. 


NEW MEXICO STATE UNIVERSITY 
Position Announcement 

The Department of Computer Science will have 
tenure-track position(s) available beginning Fall 
1987. Applicants from all areas of computer 
science are welcome. Qualifications include a 
Ph.D. in computer science or related discipline 
and strong potential in both research and 
teaching. 

The department offers B.S., M.S., and Ph.D. pro¬ 
grams. Currently there are 12 full-time regular 
faculty with active research areas including ar¬ 
tificial intelligence, computer architecture, pro¬ 
gramming languages, and operating systems. 

In Spring 1987, the Department will move into a 
tine new building which will contain excellent 
computing facilities connected to a campus¬ 
wide network, the Rio Grande Research Corridor 
network, and CSNet. 

The Computing Research Laboratory (CRL) at 
New Mexico State University is one of five 
Centers of Technical Excellence established by 
the state of New Mexico. The CRL provides op¬ 
portunities for research support and is currently 
funding computer science faculty and graduate 
students in the areas of artificial intelligence, 
networking, cognitive modeling, database sys¬ 
tems, and computer vision. 

To apply, please send a resume including the 
names and addresses of three references to Pro¬ 
fessor Yorick Wilks, Department of Computer 
Science, Box 3CU, Las Cruces, NM 88003-0099. 
Position will be open at least until March 15, 
1987. AA/EEO Employer 


UNIVERSITY OF CALIFORNIA 
SANTA BARBARA 

Electrical and Computer Engineering 

Applications are invited for three tenure track 
faculty positions in computer engineering. One 
position is in the area of design automation 
(CAD tools, techniques, algorithms, or expert 
systems) to support and/or validate VLSI-based 
designs. The remaining positions may be filled 
from any specialty within computer engineering, 
with preference given to applicants experienced 
In the fields of parallel computing, very high¬ 
speed digital circuit design/analysis, or fault- 
tolerant computing. The positions start at the 
rank of Assistant Professor, although higher 
level appointments are possible for individuals 
with outstanding records. Normally, completion 
of a doctorate is required at the time of the ap¬ 
pointment. Candidates should have an outstand¬ 
ing research potential or a distinguished re¬ 
search reputation, the ability to attract external 
research funding, and a strong commitment to 
teaching at the undergraduate and graduate 
levels. Applicants should send their resume, 
copies of recent publications, and the names of 
at least four professional references to: Chair¬ 
man, Computer Engineering Faculty Search 
Committee, Electrical and Computer Engineer¬ 
ing, University of California, Santa Barbara, CA 
93106, (805) 961-3821. Applications will be re¬ 
ceived until the positions are filled. An Equal Op¬ 
portunity/Affirmative Action employer. 


NAVAL POSTGRADUATE SCHOOL 
Monterey, CA 

Position Announcement in Computer Science 

The Department of Computer Science has im¬ 
mediate openings for faculty positions at all 
levels in the areas of Artificial Intelligence and 
Computer Architecture. An applicant should 
have a PhD in Computer Science or a related 
field and have a strong interest In both graduate 
teaching and research. Senior applicants must 
have distinguished research records. Appoint¬ 
ments can begin at any time during the year. 
The Department offers MS and PhD degrees in 
Computer Science supported by well-equipped 
Instructional/research facilities and a full-time 
technical staff. The faculty normally teach for 
two quarters and conduct full-time research sup¬ 
ported by major research programs during the 
other two quarters. 

Please send a detailed resume and three letters 
of reference to: Professor Vincent Lum, Chair, 
Computer Science Department (Code 52), Naval 
Postgraduate School, Monterey, CA 93943, tele¬ 
phone (408) 646-2449. NPS IS AN EQUAL OP¬ 
PORTUNITY/AFFIRMATIVE ACTION EM¬ 
PLOYER. 


WASHINGTON UNIVERSITY IN ST. LOUIS 

The Department of Electrical Engineering at 
Washington University in St. Louis is seeking a 
new Chairman to guide an expansion of about 
one-third from its present eighteen person level: 
additional positions are anticipated from retire¬ 
ment over the next decade. A major gift to under¬ 
write the opening phases of this development is 
already in hand. Persons desiring additional In¬ 
formation should write or telephone Professor 
Fred J. Rosenbaum, Department of Electrical En¬ 
gineering, Washington University, St. Louis, 
Missouri 63130 [(314)889-6154]. Washington Uni¬ 
versity Is always Interested in superior appli¬ 
cants regardless of race, creed, color, gender or 
age. 
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CALIFORNIA STATE UNIVERSITY, HAYWARD 
Department of Mathematics 
and Computer Science 

The department is now seeking appiicants for 
tenure track Assistant Professor positions in 
Computer Science beginning Faii, 1987. Par- 
ticulariy weil qualified, experienced individuals 
with the capabiiity to exercise leadership in the 
program may apply for appointment at the rank 
of Associate Professor. 

Applicants should have the Ph.D. in Computer 
Science, or in a related field with computer 
science experience. They should have a commit¬ 
ment to excellence in teaching and awillingness 
and an ability to participate in curriculum 
development. Applicants should also exhibit the 
competence and potential to engage in signifi¬ 
cant professional activities, including research 
and publication. All areas of specialization will 
be considered. The interests of the present 
faculty include a wide range of theory, software 
design, and hardware design topics. 

CSU, Hayward is located in the hills above, and 
overlooking, the eastern shore of the San Fran¬ 
cisco Bay. More than 12,000 students attend this 
university, which has outstanding programs in 
arts, letters, science, and business. The Depart¬ 
ment of Mathematics and Computer Science 
enrolls nearly 1300 majors in its three degree 
programs: B.S. in Computer Science, B.S. in 
Mathematics, and M.S. in Mathematics. An M.S. 
in Computer Science is being planned. 

The department has a Pyramid 90x minicom¬ 
puter and four Sun3-160 color workstations con¬ 
nected on an Ethernet, a graphics lab, an interac¬ 
tive classroom, a digital and a microprocessor 
lab, and numerous IBM PC’s for faculty use. In 
addition, the campus has a Cyber 170, a PDP 
11 /44, a PRIM E 9720, and numerous PC's for stu- 

Interested applicants should send a resume and 
the names of three references to 
William R. Nico, Chair 

Department of Mathematics and Computer 
Science 

California State University, Hayward 
Hayward, CA 94542 
UUCP: ... ucbvaxilll-crgicsuhinico 
Applications received by February 20, 1987, will 
be assured full consideration. Applications will 
be accepted as long as positions remain 
available. 

California State University, Hayward, is an Equal 
Opportunity/Affirmative Action employer and en¬ 
courages applications from women and men of 
all ethnic backgrounds and physical abilities. 
UNIVERSITY OF ALBERTA 
Department of Computing Science 

The Department of Computing Science is 
undergoing an extensive expansion in research 
initiatives. Applications are invited for four 
tenure-track positions at the Assistant/ 
Associate Professor level. Responsibilities in¬ 
clude research as well as teaching at the 
graduate and undergraduate levels. Candidates 
from all areas will be considered. Current hard¬ 
ware support includes an Amdahl 5870, a net¬ 
work of VAX 11/780's, and well equipped 
microcomputer and workstation laboratories for 
graphics, VLSI, and Al research. Access to a 
Cyber 205 is available. Salary range is $31,612 to 
$50,630 and Is commensurate with qualifica¬ 
tions and experience. Send curriculum vitae, 
names of three references, and up to three 
reprints or papers. New Ph.D.’s should also in¬ 
clude a copy of their transcript. Apply to: 

Dr. Lee White, Chairman 
Department of Computing Science 
University of Alberta 
Edmonton, Alberta T6G 2H1 
Applications will be accepted until April 30, 
1987. The University of Alberta is an equal oppor¬ 
tunity employer. 


QUEEN’S UNIVERSITY AT KINGSTON 
Department of Electrical Engineering 

Applications are invited for a new tenure-track 
position in the Computer Engineering program 
of the Department. Applicants should have ex¬ 
pertise in one or more of the following areas: 
microprocessors; computer architecture and 
systems; computer communications and net¬ 
works; VLSI and digital systems design. Basic 
duties will include undergraduate and graduate 
teaching, research compatible with the depart¬ 
mental program and participation with other 
staff in the academic and administrative affairs 
of the department. Rank and salary will be com¬ 
mensurate with qualifications and experience. A 
Ph.D. degree is required. Candidates of both 
sexes are equally encouraged to apply. This 
tenure-track position is provided by the Queen’s 
University National Scholars Program which has 
been established to promote the highest stan¬ 
dard of excellence. In accordance with Canadian 
Immigration requirements priority will be given 
to Canadian citizens and permanent residents. 
Send a detailed career summary with names and 
addresses of three referees to Dr. G. J. M. Aitken, 
Head, Department of Electrical Engineering, 
Queen’s University, Kingston, Ontario, K7L 3N6. 
Please quote reference number: Q-16-86. 


UNIVERSITY OF CALIFORNIA 
SANTA BARBARA 

The UNIVERSITY OF CALIFORNIA AT SANTA 
BARBARA invites applications for four tenure 
track positions at senior professorial levels in 
the Department of Computer Science, and for 
three additional positions in closely related 
areas, including computer engineering. The 
Department of Computer Science is in a rapidly 
expanding College of Engineering that has 
achieved national prominence in many areas of 
research. UCSB and the College of Engineering 
are highly committed to augmenting its Com¬ 
puter Science Department into a department 
that has both excellence and national visibility. 
The senior positions in Computer Science cur¬ 
rently available are in three major areas of 
research in which the Department of Computer 
Science intends to achieve its greatest strength. 
These areas are: machine vision and motion 
planning; parallel computing; and software 
engineering. These positions will provide oppor¬ 
tunities for successful candidates to guide the 
growth and development of the Department in 
these areas. Strong material support will be 
given to such positions. “State of the Art” 
laboratories are currently being planned for in¬ 
structional purposes in these areas. Research 
facilities in these areas will be made available 
and tailored to the needs of successful ap¬ 
plicants. Graduate student support will be given 
high priority. 

Interactions with various research groups on 
campus (Center for Robotic Systems, Cognitive 
Science Program, Center for Scientific Com¬ 
puting, Institute for Theoretical Physics, etc.) 
will be strongly encouraged and supported. 
Applicants must possess a doctoral degree and 
an extremely strong record of research ac¬ 
complishments. Teaching experience is desir¬ 
able. Outstanding younger candidates are also 
encouraged to apply. Deadline for receipt of ap¬ 
plications is February 15,1987. Send resume and 
names of at least eight references to: 

Chairman 

Computer Science Faculty Search 
Committee 

Department of Computer Science 

University of California 

Santa Barbara, CA 93106 
The University of California is an Equal Oppor¬ 
tunity/Affirmative Action Employer. 


WORCESTER POLYTECHNIC INSTITUTE, 

The Computer Science Department invites ap¬ 
plications for tenure track faculty positions at all 
levels from candidates in all areas of specializa¬ 
tion. Candidates should have a Ph.D. in Com¬ 
puter Science and a strong interest in both 
research and teaching. 

Worcester Polytechnic Institute emphasizes 
quality in the undergraduate learning experience 
and is committed to an innovative project- 
oriented teaching environment. The quality of 
the undergraduate computer science degree has 
been recognized by the recent granting of ac¬ 
creditation by the Computing Sciences Ac¬ 
creditation Board. 

The current goal of the Institute is to enhance 
our graduate program and improve research ac¬ 
tivities. The department seeks qualified can¬ 
didates who will help us achieve these objec¬ 
tives. WPI is located close to the center of 
Massachusetts’ minicomputer industry, and ex¬ 
cellent opportunities exist for cooperative 
research and consulting. 

The Department has 12 full-time faculty with 200 
undergraduates and 35 graduate students in our 
M.S. and Ph D. programs. Department equip¬ 
ment includes three VAX 750’s, an MV8000, 
twenty PDP-11's, and 40 PC’s. Much of this 
equipment is networked via two ethernet cables 
and is also connected to other campus facilities 
which include a DEC 2060 and numerous VAX’s. 
The Institute is committed to a new Information 
Science building and full campus networking 
facilities in the near future. 

Located only 45 miles from Boston, Worcester is 
a small city of 180,000 which has recently 
undergone a renaissance. It has eight colleges 
and universities and a rich variety of cultural 
activities. 

Please send a resume to Prof. R.E. Kinicki, Head, 
Department of Computer Science, WPI, 
Worcester, MA 01609. 

WPI is an Equal Opportunity/Affirmative Action 
Employer. 


THE UNIVERSITY OF WESTERN ONTARIO 
Department of Computer Science 

Applications are invited for two tenure track 
positions ai the level of Assistant or Associate 
Professor in the Department of Computer 
Science. The Department offers BSc (accredited 
by the Canadian Information Processing Socie¬ 
ty), MSc and PhD degrees in Computer Science. 
Research areas include: artificial intelligence, 
computer graphics, computer security, design 
and analysis of algorithms, formal languages 
and automata, image processing, medical imag¬ 
ing, numerical analysis and software engineer¬ 
ing. The Department has in-house facilities 
(three VAXes), a 24-Sun 3/50 network (with file 
servers) dedicated to faculty and graduate 
students, a variety of micros, graphics terminals, 
two ORCATECH 3050, and a COSMOS imaging 
machine. The Department can also access on- 
campus facilities such as a DEC-1091, a Cyber 
825, a VAX 8600 and an IBM 4341. Preference wil I 
be given to candidates with a PhD (or equivalent 
research experience) in computer networks and 
architecture, software engineering, graphics in¬ 
terfaces, expert systems and medical imaging. 
The appointments are subject to budget ap¬ 
proval. Applications and curriculum vitae, in¬ 
cluding names of three references and up to 
three papers, should be sent, no laterthan March 
31, 1987, to: Professor I. Gargantini, Chairman, 
Department of Computer Science, The Universi¬ 
ty of Western Ontario, Middlesex College, Lon¬ 
don, Ontario, Canada. N6A 5B7. 

In accordance with Canadian Immigration re¬ 
quirements, priority will be given to Canadian 
Citizens and Permanent residents of Canada. 
“An Equal Opportunity Employer.” 


January 1987 


135 






OHIO STATE UNIVERSITY 
Department of Computer and 
Information Science 

Applications are invited for faculty positions at 
all levels. A Ph.D. in computer science or a close¬ 
ly related field is required. Of special interest are 
candidates in the areas of artificiai intelligence, 
computr graphics, data bases, parailei and dis¬ 
tributed computing, software engineering, and 
VLSi design. Special research support packages 
are negotiable for highly qualified candidates. 
Research computing facilities within the Depart¬ 
ment include DEC 20/60, VAX 11/780, IBM 4341, 
AT&T 3B2, Xerox Lisp and XDE machines. Sun 
and HP workstations, and several experimental 
multi-computers (Intel Hypercube, BBN Butter¬ 
fly, etc.). In addition to the University’s com¬ 
puting facilities (IBM 3081-D, etc.) the de¬ 
partment also has access to national networks 
including ARPANET and CSNET. 

To apply, please send application and resume. 
Including a statement of research and teaching 
interests and he names and address of at least 
three references, to Prof. Ming T. (Mike) Liu, 
chairman of Faculty Search Committee, Depart¬ 
ment of Computer and Information Science, The 
Ohio State University, 2036 Neil Avenue, Colum¬ 
bus, Ohio 43210-1277 (CSNET/ARPANET:LIU @ 
Ohio-State.) The Ohio State University is an 
equal opporunity/atfirmative action employer. 


THE PENNSYLVANIA STATE UNIVERSITY 
Computer Engineering 

Applications are invited for tenure-track and 
visiting faculty positions at all levels. Can¬ 
didates from all areas of computer engineering 
(hardware and software) will be considered. The 
computer engineering program at the Pennsyl¬ 
vania State University is within the Department 
of Electrical Engineering which has over 50 
faculty members, and approximately 1500 under¬ 
graduate majors, 170 graduate students. Can¬ 
didates should have a PhD in Electrical/Com¬ 
puter Engineering or related areas. There are 15 
faculty members within the computer engineer¬ 
ing program. Excellent instruction and research 
computing facilities are available within the 
department, college and at the university com¬ 
puting center. 

Please send your letter of application, resume, or 
inquiries, together with three references to: T. 
Feng, Computer Engineering Program, Depart¬ 
ment Of Electrical Engineering, 129 Electrical 
Engineering East, Box C, The Pennsylvania State 
University, University Park, PA 16802. 

Deadline for applications is March 31,1987 or un¬ 
til suitable qualified candidates are selected. An 
Equal Opportunity/Affirmative Action Employer. 


STANFORD UNIVERSITY 
Computer Science Department 

The department has several openings tor tenure 
track positions in theoretical computer science. 
The term theoretical computer science is to be 
broadly construed to include work of a theoreti¬ 
cal nature in areas such as programming lan¬ 
guages, robotics, graphics and computer-aided 
design, artificial intelligence, etc., in addition to 
the more classical areas of algorithms and com¬ 
plexity. Applicants must have a record of strong 
research and an interest and competence in 
teaching. 

Candidates should send curriculum vitae with 
suggested references to Prof. Leonidas J. 
Guibas, c/o Phyllis Winkler, Computer Science 
Department, Stanford University, Stanford, CA 
94305. A deadline of Janua^ 31, 1987 is sug¬ 
gested for fullest consideration. 

Stanford is an Equal Opportunity/Affirmative Ac¬ 
tion employer and welcomes applications from 
women and minorities. 


UNIVERSITY OF MARYLAND 
Information Systems 

The Information Systems department has a 
tenure-track position available at the Associate 
or Assistant Professor level. Applicants with an 
interest in both research and teaching are being 
sought. Attractive salaries are offered. 
Information Systems is an active, growing 
department at the University of Maryland. The 
graduate program attracts quality students for 
M.S. and Ph.D. degrees In Information Systems. 
Current research in our Database Systems 
Research Center includes topics in database 
systems optimization, database design, office 
information systems, knowledge based sys¬ 
tems, and systems analysis and design. 

For advantageous consideration, applications 
should be received by February 1, 1987. Can¬ 
didates should send complete resumes and 
names of three references to: Prof. Alan R. 
Hevner, Search Committee Chairperson, Infor¬ 
mation Systems, College of Business and 
Management, University of Maryland, College 
Park, MD 20742, (301) 454-3260. The University of 
Maryland is an Equal Opportunity, Affirmative 
Action Employer. Women and minorities are en¬ 
couraged to apply. 

BUCKNELL UNIVERSITY 

Bucknell University invites applications for 
tenure track faculty positions at the assistant or 
associate professor level. A Ph.D in Computer 
Science or related discipline is normally re¬ 
quired. Applicants should demonstrate both an 
interest in and a promise of developing excel¬ 
lence in teaching and research. All research 
areas considered. First year research and sum¬ 
mer support funds available. 

The computing environment includes VAX 
11/780 VMS, VAX 11/750 UNIX, Sun3 and Apollo 
workstations, DG Eclipse network lab, HP In¬ 
strumentation lab, VAX Station II, and a Honey¬ 
well Level 66 DPS mainframe. 

Please send a curriculum vitae and the names of 
three references to Gary Haggard, Dept, of 
Comp. Sci., Bucknell Univ., Lewisburg, PA 17837 
or HAGGARD@BUCKNELL.BITNET. Applica¬ 
tions will be considered beginning November 15. 
Appointments for January 1987 are possible. 
Applications from women and members of mi¬ 
nority groups are encouraged. 


UNIVERSITY OF CALIFORNIA, SANTA CRUZ 
Computer Engineering 
Computer and Information Sciences 

The boards of Studies in Computer Engineering 
and Computer and Information Sciences at the 
University of California, Santa Cruz, invite appli¬ 
cations for positions as Assistant, Associate or 
Full Professor, as appropriate, effective July 1, 
1987. The Division of Natural Sciences at UCSC 
is expanding its program in Computer and Infor¬ 
mation Sciences and its new program in Com¬ 
puter Engineering. UCSC currently offers the 
B.A., M.S., and Ph.D. in Computer and Informa¬ 
tion Sciences, the B.A. in Computer Engineering, 
and is developing a graduate program in Com¬ 
puter Engineering. 

UCSC is the University of California campus 
nearest to "Silicon Valley” and is developing 
close ties with local industry in the computer 
field. Faculty salaries are competitive, and op¬ 
portunities for consulting are extensive. UCSC 
has several outstanding science departments, 
which have significant interests in scientific 
computing, including physics and astrophysics, 
data acquisition and reduction in astronomy 
(with the Lick Observatory and the Keck ten- 
meter telescope) and seismic data processing 
with the UCSC Richter Seismology Laboratory. 
AREAS OF INTEREST: Outstanding candidates 


from any specialty within computer engineering 
or computer science are encouraged to apply for 
these positions. Of particular interest are can¬ 
didates in computer science with strengths in 
(one or more of) the following areas: artificial in¬ 
telligence; database and expert Systems; theory 
and analysis of algorithms (especially algo¬ 
rithms for language processing, scheduling, 
graphics and image processing, and parallel 
computation); and in programming languages 
and compiler construction. In computer engi¬ 
neering, candidates in areas such as software 
engineering; computer and system architecture; 
workstations, servers and networks; special pur¬ 
pose architectures (as in signal and image pro¬ 
cessing); computers as components in larger 
Systems; and in computer-aided design; circuit 
and system modeling, testing, and performance 
evaluation, are of particular interest. 

RANK: Associate or Full Professor (Please refer 
to #63-867 in your reply.) 

MINIMUM QUALIFICATIONS: Ph.D. in Electrical 
Engineering, Computer Engineering, Computer 
Science, or equivalent, and a solid research 
record as evidenced by publications in technical 
journals. Applicants will be evaluated on their 
research record, teaching, professional ac¬ 
tivities and demonstrated leadership in their 
field. Industrial experience will be favorably con¬ 
sidered. 

SALARY: Commensurate with qualifications and 
experience. 

EFFECTIVE: July 1,1987 
TO APPLY: Send applications, including cur¬ 
riculum vitae with cover letter, teaching evalua¬ 
tions, copies of any recent publications, and at 
least five letters of recommendation evaluating 
your scholarly contributions, teaching, and other 
professional accomplishments to the address 

CLOsiNG DATE: January 15, 1987. 

RANK: Assistant Professor (Please refer to 
#64-867 in yOur reply.) 

MINIMUM QUALIFICATIONS: Ph.D. in Computer 
Engineering, Computer Science, or equivalent 
and demonstrated potential for research and 
teaching. 

SALARY: Commensurate with qualifications and 
experience. 

EFFECTIVE: July 1, 1987 
TO APPLY: Send applications, including cur¬ 
riculum vitae with cover letter, and at least three 
letters of recommendation evaluating your 
scholarly contributions, teaching, and other pro¬ 
fessional accomplishments to the address 
below. 

CLOSING DATE: February 27, 1987 
SEND APPLICATIONS TO: 

Chair, Computer Faculty Search Committee 
Applied Sciences Building 
University of California 
Santa Cruz, California; 95064 
UCSC IS AN EEO/AA EMPLOYER 


FACULTY FOR EUROPE AND ASIA 

Planning a sabbatical or leave of absence? The 
University of Maryland University College seeks 
excellent lecturers for undergraduate computer 
science, computer applications, and information 
systems management courses on U.S. military 
bases in Europe and in Asia and the Pacific. 
Renewable annual appointments begin August 
1987. Minimum requirements include a master’s 
degree in computer science or a related field, re¬ 
cent college teaching experience, and U.S. citi¬ 
zenship. Benefits include transportation and 
military base privileges. Frequent travel and the 
cost of schooling make these positions difficult 
for those with children. Send resume to Dr. Lois 
A. Mohr, Overseas Programs, The University of 
Maryland University College, College Park, MD 
20742-1642. AA/EEO. 
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THE UNIVERSITY OF MISSOURI-ROLLA 
Chairperson 

Department of Computer Science 

The University of Missouri-Roiia invites nomina¬ 
tions and appiications for Chairperson of the 
Department of Computer Science. 

The University and the State of Missouri are 
committed to excellence in Computer Science 
education and research at the University of 
Missouri-Roiia. This has been demonstrated by 
an exceiient undergraduate program which is ac¬ 
credited by the CSAB, by the oniy Ph.D. program 
offered by pubiic institutions in Missouri, and by 
the estabiishment of an Inteiiigent Industriai 
Systems Program and an Artificial Intelligence 
Institute. The department has extensive com¬ 
puting facilities for research in artificial in¬ 
telligence, real time computing, networking and 
interactive graphics, 

A successful candidate will have an established 
research record, skills and experience in obtain¬ 
ing external funding from governmental and in¬ 
dustrial sources, administrative skiils, and the 
experience to set goals and important directions 
for the department. A Ph.D. in computer science 
or a oloseiy related field is required. Salary is 
very competitive. 

The University is situated on Interstate 44 within 
2 hours driving time from St. Louis, Springfield, 
Jefferson City and Columbia in a pleasant non- 
urban environment. The area is rich in outdoor 
recreational opportunities. 

Nominations and applications should be sent to: 
Dr. Billy E. Gillett, Chairman of Search Commit¬ 
tee, Department of Computer Science, Universi¬ 
ty of Missouri-Rolla, Rolla, Missouri 65401. Ap- 
piioations and nominations will be considered 
beginning December 1,1986 and as received un¬ 
til the position is filled. Equal Opportunity/Affir¬ 
mative Action Employer. 


DUKE UNIVERSITY 
Department of Computer Science 

The Duke University Department of Computer 
Science, a 1983 recipient of an NSF CER Grant, 
has faculty positions available at all ranks. Ap¬ 
plications are solicited from ail areas of com¬ 
puter science. Applicants for senior positions 
must demonstrate exceilence in research, whiie 
applicants for junior positions must exhibit the 
promise of excellence. 

The Department currently has seventeen tenure 
track faculty, approximately 300 undergraduate 
majors and 50 graduate students pursuing 
master’s and/or doctoral degrees. 

The Department has major research efforts in 
scientific computing with emphasis on numeri- 
cai iinear algebra, the solution of PDEs, and VLSi 
simulation: computer systems with emphasis on 
computer architectures, modeling of fault- 
tolerant systems, systems performance, and 
communications; artificial intelligence, par¬ 
ticularly in the areas of natural language inter¬ 
face, search methodologies, and expert sys¬ 
tems; and theory and algorithms with emphasis 
on combinatorial and graph-theoretic studies. 
Special motivation for the research efforts 
comes from the areas of medical applications (in 
collaboration with the Duke Medical Center), and 
VLSI (in collaboration with the Microelectronics 
Center of North Carolina, of which Duke is a Par¬ 
ticipating Institution). 

Interested applicants should send copies of 
their resumes and other supporting material to 
Professor Donald J. Rose 
Department of Computer Science 
Duke University 
Durham, NC 27706 

Duke University is an affirmative action, equal 
opportunity employer. 


ROSE-HULMAN INSTITUTE OF TECHNOLOGY 
Chairman, Computer Science 

Applications are invited for the position of 
Department Chairman of Computer Science. Ap¬ 
plicants should have a doctorate in Computer 
Science or a related discipline (Computer Sci¬ 
ence preferred), a record of successful teaching 
computer science, strong leadership and com¬ 
munication skills, and a commitment to ex¬ 
cellence in undergraduate teaching. 
Rose-Hulman Institute of Technology, located 
on a 300 acre campus near Terre Haute, Indiana, 
is a privately endovyed school of engineering and 
science with 1300 carefully selected students in¬ 
cluding 100 national merit scholars and 30 
graduate students. The department, currently 
with five faculty members plus shared services 
from the electrical engineering, physics and 
mathematics departments, offers a strong com¬ 
puter science program with considerable elec¬ 
trical engineering and mathematics content to 
approximately 100 C.S. majors and some 25-30 
EE/CS and MA/CS double majors. A graduate 
program at the masters level is planned for the 
near future as well as application for a Computer 
Science Accreditation visitation. Computer 
facilities available to the department include an 
Institute VAX780 with 40 terminals, numerous 
PCs and a planned computer science local net¬ 
work of workstations/MicroVAX-ll. About halt of 
the student body own PCs. 

Initial screening of candidates will begin 
February 15,1987 and continue until the position 
is filled with appointment to be effective 
September 1,1987. Rank and salary will be com¬ 
mensurate with qualifications and experience. 
Send application and resume with three ref¬ 
erences to Dean James Eifert, Rose-Hulman In¬ 
stitute of Technology, 5500 Wabash Avenue, 
Terre Haute, Indiana-47803. Rose-Hulman is an 
equal opportunity employer. 

PORTLAND STATE UNIVERSITY 
Head of Computer Science Department 

Portland State University seeks an outstanding 
individual with a good understanding of the 
broad spectrum of computer science, who can 
promote quality teaching, active research and in¬ 
teraction with industry. An earned Ph.D. in com¬ 
puter science or a related field is required. 
Candidates should have the ability to work effec¬ 
tively with faculty, students, and administration. 
Salary and rank are negotiable and commen¬ 
surate with experience and qualifications. 
Portland State University, one of the three major 
universities in the Oregon State System of 
Higher Education, is located in Portland, Ore¬ 
gon, a beautiful city at the confluence of the Ool- 
umbia and Willamette rivers, offering within an 
hour or two drive a diversity of recreation—ski¬ 
ing and mountain hiking—the unspoiled Oregon 
coast—unmatched State campgrounds. 

At Portland State University, approximately 
15,0(K) students are enrolled in a number of com¬ 
prehensive academic programs at both the 
undergraduate and graduate levels. Including 
several doctoral programs. The Department of 
Computer Science has nine full time equivalent 
faculty and over 400 full- and part-time majors. 
The University places special emphasis on the 
expansion of the computer science program, in¬ 
cluding continuing evolution of the under¬ 
graduate curriculum and development at the 
graduate level. The department head is expected 
to lead this undertaking. 

The University is entering a new era of dynamic 
growth and development. During the past three 
years, the computer and electronics industry, 
the State of Oregon, and the City of Portland 
have launched major initiatives to expand com¬ 
puter science and electrical engineering educa¬ 
tion and research. Portland has a rapidly growing 
computer and electronics industry in the “sili¬ 


con forest,” including Tektronix (world head¬ 
quarters), Intel, Floating Point Systems (head¬ 
quarters), Hewlett-Packard, Oregon Software, 
Sequent Computer Systems, Metheus, Mentor 
Graphics, etc., which permits close industry-uni¬ 
versity interaction. Of particular interest, re¬ 
searchers at the nearby Oregon Graduate Center 
and the Applied Research Laboratory at Tektronix 
are acoessible for interaction and collaboration. 
Computing equipment available in the Computer 
Science Department includes a VAX 11/780 run¬ 
ning Unix, several micros and workstations in ad¬ 
dition to an IBM 4381 and a Gould 9000 ad¬ 
ministered by the Campus Computing Center. 
The position is available effective July 1, 1987. 
Forward nominations and applications, in¬ 
cluding resume and the names of three refer¬ 
ences, by February 28, 1987 to Professor M.E. 
Balogh, Chairman, Computer Science Depart¬ 
ment Head Screening Committee, do Dean’s Of¬ 
fice (EAS), School of Engineering and Applied 
Science, Portland State University, Portland, OR 
97207. 

An Equal Opportunity/Affirmative Action 
Employer. 

WORCESTER POLYTECHNIC INSTITUTE 
Head of the Computer Science Department 

Worcester Polytechnic Institute invites applica¬ 
tions and nominations for the position of Head 
of the Computer Science Department. The In¬ 
stitute seeks an individual who can provide in¬ 
novative and dynamic leadership of its educa¬ 
tional and research programs. This outstanding 
scientist and educator should have an earned 
doctorate and a distinguished record of research 
and scholarly achievement, as well as demon¬ 
strated leadership in one of the component 
specializations of Computer Science. In addition 
to administrative responsibilities, the depart¬ 
ment head will be charged with strengthening 
overall program quality and fostering scholarly 
excellence, in cooperation with other depart¬ 
ments, government and industry. 

There are 15 full time equivalent CS faculty, 260 
undergraduates, and 50 graduate students. 
Degrees are offered at the B.S., M.S., and Ph.D. 
levels. The WPI plan, a project oriented cur¬ 
riculum, forms the basis of a unique and suc¬ 
cessful undergraduate program that has been 
accredited by the Computer Science Accredita¬ 
tion Commission of the Computing Sciences 
Accreditation Board. Department laboratories 
contain three VAX 750’s, twenty PDP 11’s, a DG 
MV/8000, and an IBM Series/1 with 35 PC’s, con¬ 
nected by Ethernets. The college is committed 
to the construction of a new Information 
Sciences building. Located near Boston, in the 
center of the computer industry, Worcester has 
eight universities and colleges, and offers a rich 
variety of professional and cultural activities. 
Nominations and applications, including cur¬ 
riculum vitae and the names of three references, 
will be accepted until February 15,1987 or until a 
suitable candidate is found. 

Please respond to: 

Professor Robert A. Peura, Chairman, Computer 
Science Search Committee, Worcester 
Polytechnic Institute, Worcester, MA 01609. An 
Equal Opportunity/Affirmative Action Employer. 

AURORA UNIVERSITY 

Applications are invited for a faculty position in 
computer science with responsibilities to 
manage and teach within a new master degree 
program. Candidates should have a Ph.D. in 
computer science. AU is located within the high 
tech corridor west of Chicago. Current hardware 
support includes a VAX 11/780. Send resume, 
transcripts and three letters of reference to 
Homer E. Easley, Dean, School of Information 
Science, Aurora University, Aurora, IL 60506. 
AA/EOE 
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UNIVERSITY OF VICTORIA 
Department of Computer Science 

Applications are invited for tenure-track posi¬ 
tions at all levels to commence July 1,1987. Ap¬ 
plicants should have a Ph.D. in Computer 
Science or equivalent research achievement. 
The department has 14 full-time faculty, with 
several additional positions planned for the near 
future. It offers graduate and undergraduate 
degrees in computer science and maintains an 
active research program. The main research 
areas are programming languages, compilers, 
software engineering, distributed computing, 
fault detection, theory of computation, artificial 
intelligence, and numerical methods. The com¬ 
puting facilities available for Instructional and 
research support currently include a VAX 11/750, 
a VAX 11/780, a Pyramid 90X, 10 Sun worksta¬ 
tions, microcomputer laboratories with a variety 
of small systems, as well as the University IBM 
3083 system. Also associated with the depart¬ 
ment is the software engineering laboratory 
established by a cooperative agreement be¬ 
tween IBM Canada and the University of Victoria 
to advance the state of the art in software 
engineering. 

The city of Victoria, situated on the southern tip 
of Vancouver Island, has a population of over 
200,000. It enjoys one of the most delightful en¬ 
vironments in North America. The climate is 
temperate and all kinds of outdoor activities, 
from marine to mountian, are popular and can be 
pursued year round. 

Applicants should send a curriculum vitae and 
the names of three referees to: 

Dr. Jon C. Muzio, Chairman, 

Department of Computer Science 
University of Victoria 
P.O. Box 1700 
Victoria, B.C., Canada 
V8W2Y2 

Applications will be accepted until February 15, 
1987. Further information Is available through 
electronic mail (JMUZIO%UVUNIX.UVIC.CDN 
@ UBC.CSNET or JMUZIO® UVUNIX.BITNET) or 
from the department, (604) 721-7220. Canadian 
immigration regulations now require the univer¬ 
sity to assess applications from Canadian 
citizens and permanent residents of Canada 
before assessing applications from other per¬ 
sons. The University of Victoria offers equal 
employment opportunities to qualified male and 
female applicants. 


COLORADO SCHOOL OF MINES 

Faculty positions open for computer scientists 
in an applied program focused on software 
development, software systems, artificial in¬ 
telligence, languages and database manage¬ 
ment. Applicants should hold a Ph.D. and display 
a strong record or potential for both teaching ex¬ 
cellence and research. Rank and competitive 
salary commensurate with qualifications. 
Computer Science shares a department with 
classical applied mathematics, applied statis¬ 
tics, and operations research. Some of the 
departmental faculty are world renowned and 
the institution holds an excellent reputation for 
education and research in engineering and ap¬ 
plied science, especially in relation to minerals 
and energy. 

Applicants should send their resume and 
reference letters to Ardel J. Boss, Department of 
Mathematics, Colorado School of Mines, Gol¬ 
den, CO 80401. 

Toll free numbers: outside Colorado (1-800- 
446-9488, X 3882); inside (1-800-245-1060, x 3882). 
CSM is an Affirmative Action/Equal Opportunity 
Employer. 


TEXAS A&M UNIVERSITY 
Department of Computer Science 

Applications are invited for faculty positions at 
the Assistant, Associate or Full Professor level. 
Candidates from all areas of computer science 
will be considered. Of particular interest are 
areas central to the design of fifth generation 
computer systems. In addition to regular faculty 
positions, an endowed chair in computer ar¬ 
chitecture is to be filled. 

The Department of Computer Science has 20 
full-time equivalent senior faculty members and 
additional teaching staff. There is a tradition of 
quality instruction at the B.S., M.S. and Ph.D. 
levels. The university has initiated a major com¬ 
mitment to develop excellence in Intelligent 
Systems, Artificial Intelligence, Software 
Technology, Simulation and other areas of Com¬ 
puter Science. This commitment is in support of 
the rapid build up of microelectronics and com¬ 
puter technology in Texas, and in particular the 
decision of the Microelectronics and Computer 
Technology Corporation (MCC), the industry¬ 
wide consortium of computer manufacturers in¬ 
terested in fifth generation computer systems, 
to locate nearby. 

Computer Science at Texas A&M University is 
located in the College of Engineering. With near¬ 
ly 10,000 students, the College of Engineering is 
the nation’s largest. Computer Science is expand¬ 
ing to become one of the largest and more com¬ 
prehensive departments in the country. 

We seek excellence in research. Texas A&M will 
provide superior instructional and research 
facilities for its Computer Science faculty. The 
University has the internal resources to achieve 
this goal. Applicants at the assistant professor 
level should show substantial promise for 
research and teaching. Applicants at the higher 
level should show a strong record of research 
achievement. Ability In teaching graduates and 
undergraduates is also essential. All appoint¬ 
ments are made on a 12 month basis and 
academic salaries are highly competitive. 
Applicants should submit a resume and three 
references to: Glen N. Williams, Head, Computer 
Science Department, Texas A&M University, Col¬ 
lege Station, TX 77843. 

Texas A&M University is an equal opportunity/af¬ 
firmative action employer. 


WAYNE STATE UNIVERSITY 
Department of Electrical 
and Computer Engineering 
Chairperson 

The Department of Electrical and Computer 
Engineering at Wayne State University is seek¬ 
ing applicants with a strong leadership, 
teaching, and research background for the posi¬ 
tion of Departmental Chairperson. The Depart¬ 
ment and College, which are housed in a new 
building, are committed to a strong program that 
involves the addition of a substantial number of 
faculty and new facilities. Significant salary and 
program development funds are available. 
Wayne State University is a large urban universi¬ 
ty located in metropolitan Detroit. It is one of the 
major research universities in the state of 
Michigan and its faculty have access to ongoing 
research and development programs at research 
centers of the major automobile companies and 
other industrial organizations in the area. The 
Department has nearly 1000 students, over 200 
of which are in MS and PhD programs. The posi¬ 
tion will be filled on or before July 1, 1987. Ap¬ 
plications, including the names of three refer¬ 
ences, and nominations should be sent to Dr. 
Pieter K. Rol, Chairman of the ECE Chair Search 
Committee, College of Engineering, Wayne 
State University, Detroit, Ml 48202, no later than 
February 28,1987. Wayne State University is an 


THE UNIVERSITY OF TEXAS AT ARLINGTON 

The Department of Computer Science Engineer¬ 
ing (CSE) at the University of Texas at Arlington 
(UTA) invites your application for tenure-track or 
visiting faculty positions in all areas of computer 
science and computer engineering. Rank is 
open. An earned doctorate or equivalent and 
commitment to teaching and scholarly research 
is required. Openings are expected for June, or 
September 1987. Our department offers bacca¬ 
laureate, masters, and doctoral programs. Ex¬ 
cellent computing facilities are available in¬ 
cluding personal computers in each CSE faculty 
office. UTA is in the Dallas/Fort Worth metropoli¬ 
tan area near a large concentration of high tech¬ 
nology industries. Interested persons should 
send a resume to Professor Bill D. Carroll, Pro¬ 
fessor and Chairman, Computer Science Engi¬ 
neering Department, P.O. Box 19015, The Univer¬ 
sity of Texas at Arlington, Arlington, TX 76019. 
Phone (817) 273-3785. 

The University of Texas at Arlington is an Equal 
Opportunity Affirmative Action Employer. 


UNIVERSITY OF CALIFORNA, IRVINE 
Department of Electrical Engineering 

The Department of Electrical Engineering at the 
University of California, Irvine, invites outstand¬ 
ing individuals to apply for tenure track positions 
at all levels in the area of computer engineering. 
The levels of these appointments may be at 
Assistant Professor, Associate Professor, or 
Professor depending on accomplishments and 
stature in the field. Subareas of special interest 
include, but are not limited to 

1. parallel structured architectures 

2. artificial Intelligence 

3. software engineering 

4. computer graphics 

Responsibilities include research and teaching 
at the graduate and undergraduate levels. 

The Department has research activities in fault- 
tolerant computing, design automation, dis¬ 
tributed computing, and real-time computing, 
and in closely related areas including digital 
signal processing, image processing, pattern 
recognition, robotics, digital communication, 
and communication networks. The Department 
currently has nineteen faculty members, two of 
which are members of the National Academy of 
Engineering and seven Fellows of the IEEE. 
Send your complete resume with three refer¬ 
ences to Professor Jack Sklansky, Chairman of 
the Computer Engineering Faculty Search Com¬ 
mittee, Department of Electrical Engineering, 
University of California, Irvine, California 92717. 
The University of California is an affirmative ac¬ 
tion/equal opportunity employer. To ensure con¬ 
sideration, apply before March 15,1987. 


CLARKSON UNIVERSITY 

Faculty Position in Computer Science, Clarkson 
University. The Clarkson University Mathematics 
and Computer Science Department has a tenure 
track position available in Computer Science. 
Rank and Salary are open. Ph.D.’s with an in¬ 
terest in both reseach and teaching are being 
sought. The Department has its own minicom¬ 
puter system, a VAX 11/750. In addition, the 
university operates an IBM 4341, a VAX 11/780, 
and a number of Pro 350 personal minicom¬ 
puters, running UNIX, Presently all incoming 
freshmen are being provided with their own per¬ 
sonal computers, a Zenith Z-200. Curriculum 
vitae should be sent to Athanassios S. Fokas, 
Chairman, Department of Mathematics and 
Computer Science, Clarkson University, 
Potsdam, NY 13676. An Equal Opportunity/Affir¬ 
mative Action Employer. 
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SYRACUSE UNIVERSITY 
Dean 

School of Computer 
and Information Science 

Syracuse University invites nominations and ap¬ 
plications for the position of Dean of the School 
of Computer and Information Science. The Dean 
will lead an expanding faculty, currently 20 in 
number, active in a broad program of research 
with major concentrations in computational 
logic, programming language theory, and coding 
and information theory. There are also about 30 
affiliated faculty in other units of the University. 
The School has approximately 200 undergrad¬ 
uate, too master’s-degree, and 40 Ph.D. students 
on the main campus, and also offers graduate 
programs at three extension sites. 

The School will move to a new 130,000-square- 
foot building in September, 1988. Other units, in¬ 
cluding the Center for Advanced Technology in 
Computer Applications and Software Engineer¬ 
ing (the CASE Center) and the twenty-member 
computer engineering faculty, will also move to 
the new building. The School is associated with 
the research programs of the CASE Center and 
the Northeast Artificial Intelligence Consortium, 
and is one of the units involved in the founding of 
a center for the study of parallel architectures. 
Candidates should have an established reputa¬ 
tion in research and some experience in academ¬ 
ic administration. They should be committed to 
the advancement of computer science and to 
excellence in scholarship and teaching. The 
position requires the vision to plan and the 
leadership ability to direct the School’s recruit¬ 
ment efforts, expansion into new research areas, 
and procurement of external funds. 

Syracuse University, a private institution, has 
major programs of research, graduate studies, 
and undergraduate education. There are 11,800 
undergraduate and 4,400 graduate students on 
the main campus. 

Application and Nomination Procedures. Appli¬ 
cants should send resumes, names of refer¬ 
ences, and selected publications to: Dean 
Search Committee, School of Computer and In¬ 
formation Science, 313 Link Hall, Syracuse 
University, Syracuse, New York 13244-1240, by 
January 19, 1987. Letters of nomination should 
be sent by the same date to the above address. 
The appointment is expected to be effective no 
later than September 1, 1987. 

Syracuse University is an equal opportunity, af¬ 
firmative action employer. 


NORTH CAROLINA STATE UNIVERSITY 

The Department of Computer Science invites ap¬ 
plications for junior level tenure track positions. 
Applications are welcome from all areas, but are 
especially encouraged in the areas of operating 
systems, artificial intelligence, database sys¬ 
tems, programming languages,architecture, and 
parallel processing. Candidates must have a 
Ph.D. in computer science or a related discipline 
and have a strong interest in both research and 
teaching. 

Our department has research ties to organiza¬ 
tions in the Research Triangle Park including 
MCNC, the Microelectronics Center of North 
Carolina. On campus we have research oppor¬ 
tunities with several nationally recognized 

Applicants should submit a resume including 
research interests and three references to: 

Dr. Edward W. Davis 

Recruitment Committee 

Department of Computer Science, Box 8206 

North Carolina State University 

Raleigh, NC 27695-8206 

Immigration status of non-US citizens must be 
stated in the application. NCSU is an equal op¬ 
portunity/affirmative action employer. 


CENTRAL MICHIGAN UNIVERSITY 
Chairperson 

Computer Science Department 

The Department of Computer Science at Central 
Michigan University is seeking applicants for the 
position of chairperson. Responsibilities of the 
chairperson include all aspects of administra¬ 
tion of the department, teaching, development 
and strengthening of the undergraduate and 
graduate programs, supervision of graduate 
students, and research development and sup¬ 
port. Applicants must have a doctorate (or 
equivalent degree) in computer science or a 
related field. Candidates are expected to have 
demonstrated expertise in teaching, develop¬ 
ment of research, and administrative skills in a 
computer science setting. Salary and rank will 
be commensurate with qualifications. 

The department offers bachelor’s and master’s 
degrees in computer science. Computing 
facilities include a Cyber 170-730, a Burroughs 
XE550 running UNIX, and IBM PC and Macintosh 
micro labs. In addition, the University has just 
committed itself to a major upgrade, including a 
new mainframe and substantial increases in the 
number of micros. Faculty teaching and re¬ 
search interests include languages, compilers, 
database management systems, computer 
graphics, pattern recognition, software 
engineering, operating systems, artificial in¬ 
telligence, computer vision, algorithms and 
complexity, and networks. The department has 
about 20 FTE positions, with teaching assign¬ 
ments of 15 hours per academic year (ordinarily 
three courses one semester and two the other). 
The chairperson has a nine hour per year teach¬ 
ing assignment. 

The University is located in a community of 
about 24,000, 60 miles north of Lansing, at the 
edge of Michigan’s lakes, hills and woodlands. 
The student enrollment has held steady at about 
16,000 for several years. The University offers 
outstanding faculty benefits, including a 12% 
fully paid TIAA-CREF contribution. 

Qualified applicants should submit a detailed 
resume and three letters of reference to 
Dr. Jerald A. Kabell 
Acting Chairman 

Department of Computer Science 
Central Michigan University 
Mt. Pleasant, Ml 48859 

Applications will be accepted until March 1,1987 
or until the position is filled, whichever is later. 
Central Michigan University is an Affirmative Ac¬ 
tion/Equal Opportunity institution. Women and 
minorities are especially encouraged to apply. 


LOUISIANA STATE UNIVERSITY 
Faculty Openings 

The Department of Electrical and Computer 
Engineering at LSU invites applications for 
tenure-track and visiting faculty positions 
available August 1987 in all areas of computer 
engineering, including microprocessors, distrib¬ 
uted processing systems and special purpose 
architectures. A PhD or equivalent and potential 
for excellence in teaching and research are nec¬ 
essary. Rank is open. Salary is competitive and 
commensurate with qualifications and experi¬ 
ence. Release time and resources are provided 
in order to enhance the development of a quality 
research program. Opportunities for summer 
support are available. Send resume, names of 
three references and a statement of teaching 
and research interests to: Alan H. Marshak, 
Chairman, Electrical and Computer Engineering, 
Louisiana State University, Baton Rouge, LA 
70803-5901. LSU is an Equal Opportunity 
Employer. 


UNIVERSITY OF ROCHESTER 
Faculty Position 

Management of Information Systems 

Assistant/Associate/Full Professor of Computer 
and Information Systems. Will engage in 
graduate teaching, research, dissertation super¬ 
vision and related duties in the computer and in¬ 
formation systems area in the University of 
Rochester’s William E. Simon Graduate School 
of Business Administration. Strong training in in¬ 
formation systems (MIS, Computer Science or 
related areas) required; complementary training 
in economics or operations research desirable. 
Will do advanced teaching in the information 
systems area and research leading to publica¬ 
tions in leading scholarly journals in all areas of 
information systems management including the 
Design and Analysis of Systems, Economics of 
Information Systems Management, Database 
Management Systems, Artificial Intelligence 
and Expert Systems, Telecommunications and 
Distributed Information Systems. Ability to 
teach MBA-level courses in information systems 
required. The leadership of the School in the 
Management of Information Systems has been 
recently recognized by its winning a $2-million 
grant in IBM’s national competition. The School 
provides an excellent research environment and 
encourages interdisciplinary work. Faculty 
salaries and research support very competitive. 
Send vitae and papers to Professor Haim Men- 
delson, William E. Simon Graduate School of 
Business Administration, University of 
Rochester, Rochester, NY 14627. An Equal Op¬ 
portunity Employer (M/F). 


WAYNE STATE UNIVERSITY 

The Computer Science Department invites ap¬ 
plications for several tenure track or visiting 
positions at all levels. Applicants should have a 
Ph.D. in Computer Science or a related 
discipline and show a strong commitment to 
research in an area of Computer Science. The 
salaries will be competitive and commensurate 
with the qualifications of the candidates. 

Wayne State is one of the research universities 
in the State of Michigan. It is located In the 
cultural center of Detroit and serves the educa¬ 
tional needs of about 30,000 students. The Com¬ 
puter Science department has a full-time faculty 
of 17, offers B.S., M.S. and Ph.D. degrees, and 
has a current total of 190 graduate students (35 
Ph.D.). The current major areas of research in the 
department include database management 
systems, computer vision, distributed and 
parallel computing, software engineering, ar¬ 
tificial intelligence, and molecular computers. 
The department research facilities include ap¬ 
proximately 20 SUN and micro VAX worksta¬ 
tions, VAX 11/780, and COMPTAL vision system, 
all interconnected by Ethernet. 

The university computing center operates an 
AMDAHL 470/V6, an AMDAHL 470/V8 and 
several microprocessor labs. The university 
computer systems are accessible via Telenet 
and Autonet, and are part of the MERIT network. 
There is a growing cooperation with research 
centers of the major automobile companies and 
other industrial organizations in the area. 

Send a Curriculum Vitae and the names, ad¬ 
dresses, and telephones of at least three 
referees to Dr. Horst F. Wedde, Search Commit¬ 
tee, Computer Science Department, Wayne 
State University, Detroit, Ml 48202; tel. (313) 
577-0731, 577-2477. 

Wayne State University is an Affirmative Ac¬ 
tion/Equal Opportunity Employer. We are par¬ 
ticularly interested in minority candidates. 
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BOWDOIN COLLEGE 
Chairperson, Computer Science 

The Department of Computer Science & Informa¬ 
tion Studies seeks a person to lead the develop¬ 
ment of a young discipline at a distinguished 
undergraduate liberal arts college. To teach two 
courses per semester. Commitment to ex¬ 
cellence in undergraduate teaching and in 
research expected. Ph.D. in computer science 
preferred; applicants with Ph.D. in related field 
and sufficient computer science experience will 
be considered. Rank and tenure open. 

Bowdoin College is a private, coeducational in¬ 
stitution of 1350 students with highly selective 
admissions and a long tradition of excellence in 
scholarship. It Is located in the greater Portland 
area along the coast of Maine in Brunswick, a 
community of 18,000. 

College computing facilities include many 
microcomputers, a DEC-1091 system, and a VAX 
11/780 running UNIX. 

Salary and fringe benefits are competitive. 

To apply, send vitae and the names of three 
references to Dr. Alfred H. Fuchs, Dean of the 
Faculty, Bowdoin College, Brunswick, Maine 
04011. Applications will remain open until posi¬ 
tion is filled; review of candidates wil begin 
January 30,1987. Bowdoin College is committed 
to Equal Opportunity through Affirmative Action. 


MACROMOLECULAR WORKBENCH PROJECT 

Department of Pharmaceutical Chemistry, 
School of Pharmacy, University of California, 
San Francisco, seeks individuals at the Postdoc¬ 
toral and Assistant Research levels with ex¬ 
perience in numeric, symbolic or graphical com¬ 
puting and structures and interactions of 
biological molecules, energy calculations, and 
semi-empirical modelling, to join an active, ex¬ 
citing and well-equipped research group (R. 
Langridge, I.D. Kuntz, P.A. Kollman, F. Cohen, K. 
Dill, T.E. Ferrin, R. Abarbanel) developing and 
using computational methods to predict protein 
tertiary structure from amino acid sequence. 
Send letter of application and resume with 
names of three references to Professor Robert 
Langridge, Computer Graphics Laboratory, Uni¬ 
versity of California, San Francisco, CA 
94143-0446. UCSF is an Equal Opportunity Affir¬ 
mative Action Employer. Women and minorities 
are encouraged to apply. 


UNIVERSITY OF HOUSTON 

Applications are invited for tenure track faculty 
positions In the Department of Computer 
Science starting September 1987. Areas of 
special interest include but are not limited to ar¬ 
tificial intelligence, computer architecture, 
operating systems, programming languages and 
software engineering. Rank and salary are open 
and competitive. The Department is interested in 
expanding its research program and particularly 
welcome applicants for senior positions. Ap¬ 
plicants should have Ph.D. in Computer 
Science or a closely related area, and a strong 
commitment to research and teaching. Can¬ 
didates for senior positions should also have a 
distinguished research record. The Department 
offers Ph.D., M.S., and B.S. in Computer Science. 
Departmental research facilities Include a net¬ 
work of VAX 11/780 and VAX 11/730’s, a network 
of AT&T 3B20 and 3B2’s along with access to 
other computer facilities in the University Com¬ 
puter Center as well as supercomputers via 
remote access terminals. Send resume and 
names of professional references to Dr. Willis K. 
King, Chairman, Department of Computer 
Science, University of Houston, Houston, Texas 
77004. An Equal Opportunity/Affirmative Action 
Employer. 


ALLEGHENY COLLEGE 

The Department of Computer Science is seeking 
qualified candidates for a tenure track position 
beginning in September 1987. Applicants should 
have a Ph.D. in computer science or in a related 
discipline (Ph.D. candidates will be considered) 
and should have an interest in teaching and 
research at a liberal arts college. The computer 
science program is a rigorous one with courses 
in both the core and applications of computer 
science. The program has been accredited by 
the Computer Science Accreditation Board. 
Rank and salary are competitive and commen¬ 
surate with background and experience. We are 
looking fora candidate able to demonstrate flex¬ 
ibility and breadth as well as mathematical 
sophistication. This is an ideal opportunity fora 
person interested in teaching in an accredited 
computer science program and who also wants 
the environment of a private liberal arts college. 
Applicants shoulds submit resume, graduate 
transcript, and three letters of recommendation 
to Dr. Benjamin D. Haytock, Department of Com¬ 
puter Science, Allegheny College, Meadville, PA 
16335. Applications will be considered until the 
position has been filled or a decision has been 
made not to fill it. Allegheny College is an equal 
opportunity employer. 


RESEARCH POSITIONS 

ISI, a 15 year old autonomous research institute 
within the University of Southern California, has 
several openings in its research programs. Pro¬ 
grams have recently begun in integrated man- 
machine interfaces, uniform interfaces to multi¬ 
ple systems, knowledge representation, expert 
system diagnosis of aircraft engines, and con 
struction of intelligent user support environments. 
Ph.D. in Computer Science or related field, or 
equivalent experience is required. Send resume 
to: Ms. Lisa Moses, USC/ISI, 4676 Admiralty 
Way, Marina del Rey, CA 90292. 

USC/ISI is an Equal Opportunity/Affirmative Ac¬ 
tion Employer. 


The Department of Computer Science 
at 

OREGON STATE UNIVERSITY 
and 

TEKTRONIX, INC. 
proudly announce the new 
Tektronix Graduate Fellowships 
in 

Computer Science 

We are pleased to announce that we anticipate 
that two new graduate fellowships In Computer 
Science at Oregon State University will be 
awarded, beginning with the fall quarter of 1987. 
These fellowships will carry a stipend of $10,000 

Recipients will be selected on a competitive 
basis, with undergraduate performance, scores 
on the Graduate Record Examination, and 
references as the primary sources of informa¬ 
tion. We expect that recipients will enroll in the 
PhD program in Computer Science at OSU and 
will devote their full time toward the pursuit of 

For further information, and for application 
materials, please contact: 

Walter G. Rudd, Chairman 
Department of Computer Science 
Oregon State University 
Corvallis, Oregon 97331 
503-754-3273 
Rud@oregon-state 

Oregon State University is an Affirmative Ac¬ 
tion/Equal Opportunities employer and complies 
with Section 504 of the Rehabilitation Act of 
1973. 


THE UNIVERSITY OF CONNECTICUT 
Computer Science and Engineering 

The Department of Computer Science and 
Engineering at the University of Connecticut is 
seeking highly motivated and talented faculty 
members to fill tenure track positions. The 
Department offers B.S.E., M.S., and Ph.D. 
degrees in Computer Science within the School 
of Engineering. Openings exist at the Assistant 
and Associate Professor levels while applica¬ 
tions from exceptional candidates for Full Pro¬ 
fessorships are welcome. Applications for 
visiting faculty positions will also be enter¬ 
tained. Women and minorities are particularly 
encouraged to apply. Preference will be given to 
researchers with expertise in artificial in¬ 
telligence and computer architecture or digital 
systems, although all qualified applicants will be 
considered. A full range of computing equip¬ 
ment including a CSNET link provides an en¬ 
vironment conducive to research. 

The University is located in a rural area in North¬ 
east Connecticut within easy driving distance of 
several major metropolitan areas. Applicants 
with Ph.D.’s in Computer Science or equivalent 
areas with an interest in joining an emerging 
department are invited to submit resumes and 
names of three references to: Fred Maryanski, 
Head, Computer Science and Engineering 
Department, University of Connecticut, 260 
Glenbrook Road, Box U-155, Storrs, CT 06268. An 
equal opportunity employer. (Search #7A165) 


ELECTRICAL ENGINEERING 

The University of Missouri-Rolla Engineering 
Center in St. Louis Invites applications for a 
tenure-track position in the area of Electrical 
Engineering. A doctorate and research interest 
are required. Desired areas of specialization in¬ 
clude Digital System Design and Application, 
Control Systems, Computer Aided Design, Ar¬ 
tificial Intelligence, Communication Systems, 
and Software Engineering. Responsibilities in¬ 
clude a combination of graduate teaching, 
research and supen/ision of graduate students. 
St. Louis is a desirable living area with numerous 
cultural and entertainment opportunities. Center 
courses and degree programs are designed for 
evening participation by professionals em¬ 
ployed in the St. Louis high-tech community. Op¬ 
portunities exist for interaction with companies 
and agencies in the St. Louis area. Applications 
including curriculum vitae and names, telephone 
numbers, and addresses of three references and 
nominations, should be sent to Dr. Edward C. 
Bertnolli, Director, UMR Engineering Center, 
8001 Natural Bridge Road, St. Louis, MO 63121. 
Application deadline is February 1,1987, or until 
the position is filled. UMR is an affirmative ac¬ 
tion, equal opportunity institution. 


SYSTEMS ENGINEER 

Develop, implement and maintain application 
programs for inventory management systems tor 
fastener distributors/government contractors. 
Analyze limitations and capabilities of existing 
systems and propose resolutions for customers’ 
requirements. Perform accuracy analysis and 
performance evaluations. Plan new installation 
or modification of development systems. MS in 
Computer Science/Ind.Engg., familiarity with 
Material Requirement Planning Systems and 
one year experience required. Must be able to 
use TI-990, 1500, Bus-Pro/Zenix C, IBM 36/PC, 
RM COBOL computers and software. 40 hours 
per week. Interview and Job site in San Diego. 
Send this ad with resume to Job #CW 10105, P.O. 
Box 9560, Sacramento, CA 95823-0560, not later 
than February 2,1987. 
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LOUISIANA STATE UNIVERSITY 
Faculty Position in image Processing 

The Department of Electrical and Computer 
Engineering and the Remote Sensing and Image 
Processing Lalxjratory invites applications for 
an anticipated faculty position. The person 
would teach computer vision and computer engi¬ 
neering courses in the Department. Research in 
computer vision would be conducted with the 
Remote Sensing and Image Processing Labora¬ 
tory (RSIP). The position is attractive regarding a 
teaching load balanced to provide the ability to 
develop an academic program and provide lime 
and resources for developing a high quality 
research program in computer vision. The RSIP 
Laboratory has well qualified staff and modern 
computing and image processing equipment. A 
number of peripherals including Symbolics, Sun, 
and International Imaging workstations are 
available. A comprehensive image processing 
system has been implemented in Berkeley Unix 
4.3. The appointment will be made at a rank ap¬ 
propriate with the qualifications of the applicant. 
Interested applicants should apply by submit¬ 
ting a resume, statement of interests, and names 
and addresses of three professional references. 
Applications that apply by January 31,1987 will 
be given preference. Apply to: Professor Charles 
A. Harlow, Director, RSIP Laboratory, 150 Elec¬ 
trical Engineering Building, Louisiana State 
University, Baton Rouge, Louisiana 70803-5901. 
LSU is an Equal Opportunity Employer. 


HARVEY MUDD COLLEGE 
Engineering and Computer Science 

Applications are invited for a tenure track posi¬ 
tion in the Engineering Department. Appoint¬ 
ment at the Assistant Professor level is antici¬ 
pated. Applicants should have an engineering 
background with graduate study in computer 
engineering or electrical engineering and com¬ 
puter science and experience in both hardware 
and software design and development. Respon¬ 
sibilities will Include teaching in a unified 
engineering curriculum, developing courses and 


the Engineering Clinic. Continuing professional 
growth and development through research or 
consulting is expected; excellent opportunities 
exist in the local area. A doctorate In engineering 
or computer science is required. Industrial ex¬ 
perience is desirable. Reply to: Professor James 
E. Monson, Chairman, Search Committee, 
Harvey Mudd College, Claremont, CA 91711. 
Harvey Mudd College is an equal opportunity/af¬ 
firmative action employer. 


UNIVERSITY OF WISCONSIN-MADISON 
Faculty Positions 

The Department of Electrical and Computer 
Engineering invites applications for tenure and 
tenure-track faculty positions. A Ph.D. degree is 
required, and successful candidates are ex¬ 
pected to participate in both teaching and re¬ 
search activities. Applicants in all areas of com¬ 
puter engineering are invited to apply, but the 
following areas are of special interest: computer 
architecture, computer networks, large-scale 
computational methods, real-time computer ap¬ 
plications, design automation, VLSI circuit 
design, and engineering applications of artificial 
intelligence. Rank and salary will be commen¬ 
surate with qualifications and experience. Send 
resume and names of three references to J. Leon 
Shohet, Chairman, Department of Electrical and 
Computer Engineering, University of Wisconsin- 
Madison, 1415 Johnson Drive, Madison, Wl 
53706, an equal opportunity/affirmative action 
employer. 


THE CENTER FOR 
ADVANCED COMPUTER STUDIES 
RESEARCH FACULTY 

GRADUATE FELLOWSHIPS/ASSISTANTSHIPS 
in COMPUTER SCIENCE/ENGINEERING 
University of Southwestern Louisiana 

The Center for Advanced Computer Studies is a 
research center wih programs leading to 
MS/PhD degrees in Computer Science and Com¬ 
puter Engineering. External grants/contracts 
support research in a variety of areas. The Com¬ 
puting Research Laboratory includes a 40-node 
Sun-3 network, a 6-processor Encore Multimax, 2 
VAX 11/780S, logic development systems, laser 
printers, plotters, and numerous other equip¬ 
ment. Instruction utilizes a 3-processor Pyramid 
90X network running UNIX and an IBM 30^ with 
a vector processor. Another well-equipped facili¬ 
ty supports research in CAD/CAM. About 300 
students are enrolled in computing graduate pro¬ 
grams. 

RESEARCH FACULTY: Applications are invited 
from persons holding PhD degrees with demon¬ 
strated research capabilities in Computer 
Science/Engineering. Persons appointed as 
Assistant Professors must hold PhDs in Com¬ 
puter Science/Engineering and have research 
potential. Associate Professors and Professors 
must hold PhDs and have an established re¬ 
search publication and grant record. The typical 
teaching load is 2 graduate-level courses per 
year and a continuing research seminar. Salaries 
range from about $50,000 to over $100,000 per 
year. Excellent support is provided for travel, 
equipment, research assistants, and profes¬ 
sional activities. Thus, the necessary environ¬ 
ment exists to achieve your professional goals. 
To apply, send a copy of your curriculum vitae 
and the names and addresses of at least 3 pro¬ 
fessional references. Applications will be con¬ 
sidered until all positions are filled. 

PhD FELLOWSHIPS: A number of PhD Fellow¬ 
ships valued at more than $14,000 per year are 
available. They provide support for up to 4 years 
of study towards the PhD in Computer Science 
or Computer Engineering. Recipients also 
receive preference for low-cost campus housing. 
Completed applications must be received by 15 
February 1987. 

MS/PhD ASSISTANTSHIPS: More than 100 
teaching and research assistantships are 
available to support students pursuing an MS or 
PhD degree in Computer Science or Computer 
Engineering. Stipends are valued at from about 
$6,000 up to $12,000 per academic year. Com¬ 
pleted applications must be received by 1 March 
1987. 

APPLICATIONS: Dr. Terry M. Walker, Chairman, 
Faculty Search Committee, The Center for Ad¬ 
vanced Computer Studies, Lafayette, LA 
70504-4330. 

An Affirmative Action/Equal Opportunity 
Employer. 


UNIVERSITY OF NORTH CAROLINA 
AT WILMINGTON 

Faculty Position in Computer Science, Universi¬ 
ty of North Carolina at Wilmington, Math. Sci¬ 
ences Department, Wilmington, NC 28403-3297. 
Douglas D. Smith, Chair (919 395-3291) 
Asst./Assoc. Professor (rank and salary com¬ 
mensurate with qualifications). Begins August, 
1987, Ph.D. in computer science or Ph.D. in a 
related area with M.S. in computer science or 
equivalent experience. Any specialty con¬ 
sidered. Dept. Faculty of 30 offers bachelor’s 
degrees in computer science and in pure and ap¬ 
plied math. VAX/VMS and UNIX are in use. 
Duties include teaching, scholarship and ser¬ 
vice. Deadline: Feb. 16, but applications will be 
received until the position is filled. An EE/AA 
employer. 


DEPARTMENT LEADER 

The Department of Electrical Engineering at 
Washington University in St. Louis is seeking a 
new Chairman to guide an expansion of about 
one-third from its present eighteen person level; 
additional positions are anticipated from retire¬ 
ment over the next decade. A major gift to under¬ 
write the opening phases of this development is 
already in hand. Persons desiring additional in¬ 
formation should write or telephone Professor 
Fred J. Rosenbaum, Department of Electrical En¬ 
gineering, Washington University, St. Louis, 
Missouri 63130 [(314)889-6154). Washington Uni¬ 
versity is always interested in superior appli¬ 
cants regardless of race, creed, color, gender or 
age. 

UNIVERSITY OF ALBERTA 
Department of Computing Science 

Applications are invited for a Faculty Service Of¬ 
ficer, which is a full time academic position, as 
DIRECTOR OF INSTRUOTIONAL LABORA¬ 
TORIES, in the Department of Computing 
Science. Responsibilities include the planning 
and supervision of instructional laboratories and 
the promotion of innovations in instructional 
methodology. Candidates should have con¬ 
siderable relevant academic experience: cur¬ 
riculum planning, teaching experience, course 
development and supervisory experience. An 
M.Sc is mandatory but a Ph.D. in Computing 
Science is preferred. Salary will be commen¬ 
surate with qualifications and experience; cur¬ 
rently salary floor is $39,620. Departmental in¬ 
structional laboratory facilities currently include 
four time-sharing terminal labs connected to the 
University Amdahl 5870 mainframe computer, 
three Macintosh PC Labs operated stand-alone 
or connected to the mainframe, a logic lab, and a 
micro-computer lab. A VAX 11/780 is largely 
devoted to several undergraduate courses, runn¬ 
ing under a UNIX operating system. Applica¬ 
tions, including a detailed resume and the 
names of three academic references should be 
submitted to: 

Dr. Lee J. White, Chairman 

Department of Computing Science 

University of Alberta 

Edmonton, Alberta T6G 2H1 
The closing date for applications is April 30,1987 
or earlier if a qualified candidate is found. The 
University of Alberta is an equal opportunity 
employer. 

UNIVERSITY OF WASHINGTON 

The University of Washington expects openings 
for junior and/or senior tenure-track faculty ap¬ 
pointments in Computer Science starting In the 
1987-88 academic year. A moderate teaching 
load allows time for both quality research and 
close involvement with students. As a conse¬ 
quence, we expect applicants to have a strong 
commitment to both research and teaching and 
an outstanding record of research for their level. 
A senior level applicant should have a record that 
would provide significant new research strength 
for our department. We invite applicants from all 
areas of Computer Science, quality being our 
most important selection criterion. We would 
particularly welcome applicants with research 
strength in artificial intelligence, programming 
languages and compilers, computer systems, 
and databases. In addition to the above tenure- 
track positions the department may have a 
number of visiting positions; these would re¬ 
quire both teaching and research, and could be 
for any portion of the 1987-88 academic year. 
Interested applicants should send a letter of ap¬ 
plication, a resume, and the names of four 
references to Paul Young, Chairman, Depart¬ 
ment of Computer Science FR-35, University of 
Washington, Seattle, Washington 98195. 

The University of Washington is an Affirmative 
Action/Equal Opportunity Employer. The Ph.D. is 
required for these positions. 
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THE JOHNS HOPKINS UNIVERSITY 
Department of Computer Science 

The Johns Hopkins University has formed an in¬ 
dependent Department of Computer Science 
within the G.W.C. Whiting Schooi of Engineer¬ 
ing. During the next five years, a facuity of ap- 
proximateiy sixteen wili be deveioped to repre¬ 
sent the University in the fieid of computer 
science and engineering according to Hopkins’ 
traditionai standards of research and teaching of 
the highest rank. Construction of a new buiiding 
to house the department wiii begin during the 
faii of 1986. Additionai facuity are sought at aii 
professoriai ieveis with research and teaching 
interests in artificiai inteiiigence, computer vi¬ 
sion, graphics, programming ianguages, sys¬ 
tems (especiaiiy paraiiei and distributed com¬ 
puting and networks), and theory. Senior can¬ 
didates should have an outstanding record of 
research achievement; junior candidates should 
exhibit superior research potential. Although the 
teaching load is moderate, genuine commitment 
to teaching excellent graduates and under¬ 
graduates is also necessary. 

Applicants should send a resume and the names 
of at least three references to: Professor Gerald 
M. Masson, Department of Computer Science, 
The Johns Hopkins University, Baltimore, MD 
21218 [phone: (301) 338-8775]. The Johns 
Hopkins University is an equal opportunity, affir¬ 
mative action employer. 

THE UNITED STATES 
NAVAL ACADEMY 

Applications are invited for tenure-track posi¬ 
tions in the Computer Science Department. An 
earned Ph.D. in Computer Science or related 
field is required. The applicant must have a 
strong interest in combining teaching with 
research in a very high quality undergraduate 
program. Previous teaching experience is prefer¬ 


red. Applicants should be .able to teach upper 
division mainstream computer science courses. 
Civilian faculty receive Excepted Civil Service 
appointment with initial appointment normally 
for three years. Salary commensurate with 
overall experience. Excellent opportunities for 
research in the local area. 

The Computer Science Department offers a 
major in Computer Science leading to a 
Bachelor of Science degree. The curriculum 
follow the latest recommendations of the ACM 
Curriculum Committee. 

Interested persons should send their vitae to: 
Chairperson, Computer Science Department, 
United States Naval Academy, Annapolis, 
Maryland 21402 (phone (301) 267-3080). 
Deadlineforreceipt of applications is 1 February 
1987; however, applications will be considered 
until the positions are filled. 

The United States Naval Academy is an Affir¬ 
mative Action Equal Opportunity Employer. 

YORK UNIVERSITY 
Faculty of Arts 

Department of Computer Science. Two tenure 
track positions at the Assistant, Associate, or 
Full Professor level. A Ph.D in Computer Sci¬ 
ence, Electrical Engineering or the equivalent is 
required. One position in computer architecture 
and one in computer network architectures and 
protocols. All areas of computer architecture will 
be considered. Areas of interest in network ar¬ 
chitecture are formal specifications of network 
protocols, network protocol verification, network 
and protocol modelling, architectural perfor¬ 
mance analysis, international standardization of 
communication architectures, and the software 
architectures of network implementations. 
Duties inlude research and undergraduate 
teaching. A Master's program Is currently under 
development. The Department’s equipment in¬ 
cludes a VAX 8600 (VAXA/MS) and a VAX 11/750 


(BSD UNIX), and Sun Workstations, as well as 
microcomputer and graphics laboratories. 
Faculty and students also have access to IBM 
4381 (VM/CMS) facilities. York’s Department of 
Computing Services engages in a variety of 
research and development projects In circuit and 
packet switched data communications. The net¬ 
work testing and development equipment, in¬ 
cluding a CBXII 9000 with ROLMbus 295, will be 
used to support academic research whenever 
appropriate. York University is located in 
Metropolitan Toronto and within easy reach of 
downtown Toronto which offers excellent cul¬ 
tural, recreational, and entertainment facilities. 
Send curriculum vitae and names of three refer¬ 
ences to Prof. E. Arjomandi, Chairman, Depart¬ 
ment of Computer Science, Faculty of Arts, York 
University, North York (Toronto), Ontario M3J 
1P3. York University is implementing a policy of 
employment equity. Qualified women and men 
are invited to apply. In accordance with Cana¬ 
dian immigration requirements, priority will be 
given to Canadian citizens and permanent 
residents of Canada. 


ITHACA COLLEGE 

The Dept, of Math/CS has two tenure eligible 
positions beginning Fall 1987. A Ph.D. in CS, 
Math, or a related discipline required. One posi¬ 
tion is in CS with rank open. Another is at the 
Assistant Professor level and selected candi¬ 
date will be expected to teach at least half the 
teaching load in CS. Strong preference will be 
given to applicants who can teach a variety of CS 
courses. Candidates with primary interest in 
math and interest in teaching some upper level 
CS courses are also encouraged to apply. Send 
vitae to Dr. Eric E. Robinson, Chair, Department 
of Mathematics and Computer Science, Ithaca 
College, Ithaca, New York 14850. An EO/AA 
Employer. 


miiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiim 

S Some New Definitions for E 

I HARDWARE DESIGN I 
I ENGINEERS | 

S P'C’sLim'it’edfraouraj-America’smosttechnologically S 
S innovative manufacturer of personal computers. ” 

S Makers of the fastest and most powerful products S 

S available. A company that pays top salaries and offers 5 
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“ Motsinger, Employment Representative, PC’s Limited, 5 

S 1611 Headway Circle, Building 3, Austin, TX 78676.” S 
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An Equal Opportunity Employer M/F 


UNIVERSITY OF VICTORIA 
Computer Science 

Applications are invited for the position of Chairperson. The appointment 
is to commence July 1, 1987. The ideal applicant would have a strong 
record of research and teaching in computer science as well as the poten¬ 
tial for academic leadership. The Department has 14 full-time faculty, with 
several additional positions planned for the near future. It offers graduate 
and undergraduate degrees in Computer Science and maintains an active 
research program. The main research areas are programming languages, 
compilers, software engineering, distributed computing, fault detection, 
theory of computation, and numerical methods. The computing facilities 
available for instructional and research support currently include a VAX 
11/750, a VAX 11/780, a Pyramid 90X, 10 SUN workstations, microcomputer 
laboratories with a variety of small systems, as well as the University IBM 
3083 system. Also associated with the Department is the Software 
Engineering Laboratory established by a cooperative agreement between 
IBM Canada and the University of Victoria to advance the state of the art of 
software engineering. 

The City of Victoria, situated on the southern tip of Vancouver island, has a 
population of over 200,000. It enjoys one of the most delightful en¬ 
vironments in North America. The climate is temperate and all kinds of out¬ 
door activities, from marine to mountain, are popular and can be pursued 
year round. 

Applicants should send a curriculum vitae and the names of three referees to: 
Dr. A.T. Matheson 
Dean, Faculty of Science 
University of Victoria 
P.O. Box 1700 

Victoria B.C. Canada V8W 2Y2 

Applications will be accepted until January 31,1987 or until the position is 
filled. Further information may be obtained by telephoning the Department 
at (604) 721-7220, or through electronic mail (e-mail addresses are jmuzio- 
%uvunix.uvic.cdn@ ubc.csnet or jmuzio® uvunix.bitnet). Canadian im¬ 
migration regulations now require the University to assess applications 
from Canadian citizens and permanent residents of Canada before assess¬ 
ing applications from other persons. The University of Victoria offers equal 
employment opportunities to qualified male and female applicants. 





WASHINGTON UNIVERSITY, ST. LOUIS 
Regular Faculty Positions in 
Computer Science 

The Department of Computer Science Is expand¬ 
ing its research program and invites applications 
for several regular (tenure-track) faculty posi¬ 
tions at the Assistant, Associate and Full Pro¬ 
fessor levels. Applicants should hold the Ph.D. 
or D.Sc degree in Computer Science and have a 
strong commitment to and record of accom¬ 
plishment in research. 

The Department of Computer Science has a well- 
respected undergraduate program and a small, 
but growing graduate program. Research ac¬ 
tivities have flourished in recent years and have 
three foci: concurrent systems, communications 
systems, and intelligent computer systems. 
Support for these research programs is from 
NSF, NIH, ONR, DMA and a large number of in¬ 
dustrial sponsors. 

Current departmental research in concurrent 
systems includes the formal foundations of con¬ 
current computation, methodologies for the 
design of distributed systems, system intercon¬ 
nection networks and parallel architectures and 
algorithms. The department is also engaged in 
research on the design of high-performance 
packet-switching systems capable of a variety of 
applications (including voice, data and video). Of 
particular interest are candidates with back¬ 
grounds in communications systems architec¬ 
ture, communications software, or performance 
analysis. In the area of intelligent computer 
systems, present research projects include com¬ 
puter vision, image processing, visual program¬ 
ming, speech recognition, expert systems and 
deductive databases. Candidates with back¬ 
grounds in any of these areas are encouraged to 
apply. 

Candidates may reply to: 

Dr. Jerome R. Cox, Jr., Chairman 
Department of Computer Science 
Washington University 
Campus Box 1045 
St. Louis, Missouri 63130 
Applications requested by February 1, 1987. 
Washington University is an equal oppor¬ 
tunity/affirmative action employer. 

UNIVERSITY OF CALIFORNIA, RIVERSIDE 

Applications are invited for a tenure-track or 
tenure position in Computer Science beginning 
Fall 1987. Candidates must have demonstrated 
excellence in research and teaching. Research 
specialties in all areas of Computer Science will 
be considered but we are particularly interested 
in research areas in Computer Systems or Com¬ 
puter Methodology and Applications. The posi¬ 
tion is open as to the level of appointment. 
Applicants should send a curriculum vitae and 
see that at least three letters of recommendation 
are sent to: 

Professor Theodore J. Barth, Chair 
Computer Science Search Committee 
Department of Mathematics and Computer 
Science 

University of California 
Riverside, CA 92521 

University of California, Riverside, is an Affir¬ 
mative Action/Equal Opportunity Employer. 
CALIFORNIA STATE POLYTECHNIC 
UNIVERSITY, POMONA 
Computer Science Department 
Computer Science: Three tenure track positions. 
Assistant or Associate Professor, specialty 
open, A.Y. beg. Sept. 1987. Ph.D. strongly pre¬ 
ferred (required for tenure or promotion). M.S. in 
C.S. with teaching experience is the minimum 
requirement. Send resume, three letters of 
reference, completed application form, confir¬ 
mation of highest degree by March 1, 1987. 
Search Committee, Computer Science Depart¬ 
ment, California State Poly University, Pomona, 
CA 91768 AA/EEO 








Now it’s our turn 


Bridge Communications, located on the beau¬ 
tiful San Francisco peninsula, is making a name 
for itself as the premier source for LAN prod¬ 
ucts and technologies. We’ve started where 
the computer industry left off.. .and the mar¬ 
ket has never been stronger for our sophisti¬ 
cated information management solutions. If 
you’d like to work independently yet share 
your ideas and findings with like-minded col¬ 
leagues in the heart of Silicon Valley, consider 
these opportunities. 

Software Engineer 

Use your experience writing synchronous line 
drivers and your knowledge of LAN data link 
and network protocols to work on the develop¬ 
ment, release, and support of internetwork 
bridges. This position is an opportunity for a 
self-starting individual who can assume project 
coordination efforts. MSCS/MSEE preferred; 
must have 3-5 years of networking experience, 
knowledge of UNIX*, C, and 68000, and famil¬ 
iarity with logic analyzers and line monitors. 
Job code: IB. 

Software Engineer 

If you’re the rare person with 'TCP/IP and X.25 
background, this is an opportunity to take on 
the development, release, and support respon¬ 
sibilities of high-performance routers and gate¬ 
ways. MSEE/MSCS and 3-5 years in networking 
required. Should be familiar with 68000 
microprocessor, C, and UNIX. Job code: RP. 

Software Engineer 

Become a member of the team working on the 
development and support of our TCP/IP com¬ 
munications servers. BSCS/BSEE required, plus 
at least 3 years networking experience includ¬ 
ing a knowledge of UNIX and C. Job code; TC. 
We offer an excellent benefits package (includ¬ 
ing stock options) and the rewards of working 
in one of the SF Bay Area’s top high-growth 
companies, lb apply, please indicate appropri¬ 
ate Job code and send your resume to: Human 
Resources, BRIDGE COMMUNICATIONS, INC., 
2081 Stierlin Road, Mountain View, CA 94043. 
An equal opportunity employer. M/F/H/V. 

'UNIX is a trademark of AT&T Bell Labs. 


Bridge 

Communications 
WM Inc. 
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CALL FOR PAPERS 


Second IEEE Computer Society Workshop on 
Software Technology Transfer 

June 10-12, 1987 
Santa Fe, New Mexico 


This workshop will provide a forum for the discussion and exchange of meth¬ 
ods and models of technology transfer. Topics to be addressed include: 

• models of the transfer process, 

• means of cooperation between research and development, 

• measurement of the transfer process, 

• the role of education and training, and 

• psychological and social issues. 

This workshop will be limited to 30-40 participants. Attendance will be deter¬ 
mined on the basis of position papers. Interested parties should submit five 
(5) copies of a 3- to 5-page position paper no later than February 15, 1987 to: 

Charles Richter 
Software Technology Program 
MCC 

P.O. Box 200195 
Austin, Texas 78720 


Organizing Committee: 

J. C. Browne, University of Texas at Austin 

Kate Ehrlich, Symbolics 

Charles Richter, MCC (General Chair) 

Bill Riddle, Software Productivity Consortium 
Joseph Urban, University of Southwestern Louisiana 

Local Arrangements: 

James Babcock, MCC 
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TRANSFUtM 

TOUR re 

INTO A 
MACHINE. 


Not long ago, a specialized 
LISP machine was your 
only choice for serious AI 
development and delivery. 

But now you can get LISP 
machine performance out of 
that ordinary IBM PC* sitting 
on your desk. With the Gold 
Hill 386 LISP System. 

You simply plug in the 
System’s HummingBoard™— 
unique 386-based hardware 
designed specifically for the LISP 
environment. Then you add the 
System’s Golden Common 
LISP 386 Developer software. 

That’s all you need to trans¬ 
form your PC into a LISP 
machine. You can develop 
and deliver AI applications 
on your PC. And create your 
own expert systems. You’ll 
get the kind of LISP perfor¬ 
mance you thought was only 
possible in a system costing 
ten times as much. 

And if you don’t need the 
whole system, Gold Hill can 
still offer you AI solutions. 

You can get GCLISP 286 
Developer software for your 
PC.* And GCLISP 386 Devel¬ 
oper software will be avail¬ 
able for leading manufacturers’ 
386-based PCs. 

Tomorrow’s AI develop¬ 
ment tools for PCs are avail¬ 
able today from Gold Hill. 

We’ll prove it to you—just call 
to get the latest Gabriel Perfor¬ 
mance Benchmarks. You’ll 
be amazed to learn what your 
PC is capable of Call toll-free: 


Gold Hill. The expert in AI on PCs. 


1-800-242-LISP 


•The Gold Hill 386 LISP System requires an IBM PC XT, AT or compatible. GCLISP 
286 Developer Software requires an IBM PC AT or compatible. 

© 1986 Gold Hill Computers, Inc. Gold Hill, Gold Hill 386 LISP System, Golden 
Common LISP, GCLISP, and Developer are trademarks of Gold Hill Computers, 

Inc. IBM PC, XT and AT are registered trademarks of International Business a 
Machines Corp. HummingBoard is a trademark of A.I. Architects, Inc. 


In Mass.: (617)492-2071 
Gold Hill Computers, Inc. 
^ 163 Harvard St., 

^ ... Cambridge, MA 02139 
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